Nov 02 10:28:38 devstack cinder-volume[75861]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:28:38 devstack cinder-volume[75861]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:28:38 devstack cinder-volume[75861]: we strongly recommend against using it for new projects. Nov 02 10:28:38 devstack cinder-volume[75861]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:28:38 devstack cinder-volume[75861]: framework. For more detail see Nov 02 10:28:38 devstack cinder-volume[75861]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:28:38 devstack cinder-volume[75861]: import eventlet # noqa Nov 02 10:28:41 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:28:41 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:28:41 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:28:41 devstack cinder-volume[75861]: INFO dbcounter [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Registered counter for database cinder Nov 02 10:28:42 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:28:42 devstack cinder-volume[75861]: DEBUG dbcounter [-] [75861] Writer thread running {{(pid=75861) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:28:42 devstack cinder-volume[75861]: INFO cinder.rpc [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:28:42 devstack cinder-volume[75861]: INFO cinder.rpc [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:28:42 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:28:42 devstack cinder-volume[75861]: INFO cinder.volume.manager [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Determined volume DB was empty at startup. Nov 02 10:28:42 devstack cinder-volume[75861]: DEBUG cinder.volume.manager [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75861) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:28:42 devstack cinder-volume[75861]: INFO cinder.volume.manager [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:28:42 devstack cinder-volume[75861]: WARNING stevedore.named [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:28:42 devstack cinder-volume[75861]: WARNING castellan.key_manager [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:28:42 devstack cinder-volume[75861]: WARNING cinder.keymgr.conf_key_mgr [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:28:42 devstack cinder-volume[75861]: DEBUG cinder.volume.drivers.lvm [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75861) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 10:28:42 devstack cinder-volume[75861]: DEBUG oslo_concurrency.processutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75861) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_concurrency.processutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] CMD "cinder-rtstool verify" returned: 0 in 0.409s {{(pid=75861) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:28:43 devstack cinder-volume[75861]: INFO cinder.rpc [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 10:28:43 devstack cinder-volume[75861]: INFO cinder.rpc [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 10:28:43 devstack cinder-volume[75861]: WARNING stevedore.named [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:28:43 devstack cinder-volume[75861]: WARNING castellan.key_manager [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:28:43 devstack cinder-volume[75861]: INFO cinder.volume.manager [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:28:43 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Starting 1 workers Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Started child 76015 {{(pid=75861) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Full set of CONF: {{(pid=75861) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] ******************************************************************************** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Configuration options gathered from: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] ================================================================================ {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] allow_availability_zone_fallback = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] allow_compression_on_image_upload = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] allowed_direct_url_schemes = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] api_rate_limit = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] auth_strategy = keystone {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] az_cache_duration = 3600 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_host = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_stats_polling_interval = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backup_api_class = cinder.backup.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backup_name_template = backup-%s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backup_use_same_host = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[76015]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backup_use_temp_snapshot = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] chap_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] chap_username = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_internal_tenant_project_id = 9c11947838034ce9a01d4e44e65d692a {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_internal_tenant_user_id = a49a53df8cb749d3b8c07e716adecde6 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cloned_volume_same_az = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cluster = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] compression_format = gzip {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] compute_api_class = cinder.compute.nova.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] config_dir = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] config_source = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] control_exchange = openstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] debug = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] default_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] default_group_type = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] default_volume_type = lvmdriver-1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] disk_geometry = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] driver_client_cert = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] driver_client_cert_key = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] driver_data_namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] driver_ssl_cert_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] driver_ssl_cert_verify = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] driver_use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] enable_force_upload = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] enable_new_services = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] enable_unsupported_driver = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] enforce_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] filter_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_api_insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_api_ssl_compression = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_ca_certificates_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_catalog_info = image:glance:publicURL {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_num_retries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance_request_timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] goodness_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] graceful_shutdown_timeout = 5 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] group_api_class = cinder.group.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] host = devstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_compress_on_upload = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_conversion_address_space_limit = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_conversion_cpu_limit = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_conversion_disable = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_introspection_address_space_limit = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_introspection_cpu_limit = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_upload_use_cinder_backend = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_upload_use_internal_tenant = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_volume_cache_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_volume_cache_max_count = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] image_volume_cache_max_size_gb = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] init_host_max_objects_retrieval = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] instance_format = [instance: %(uuid)s] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] iscsi_target_flags = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] iscsi_write_cache = on {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] iser_helper = tgtadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] iser_ip_address = 192.168.122.246 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] iser_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_color = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_config_append = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_dir = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_options = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_rotate_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_rotate_interval_type = days {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] log_rotation_type = none {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] max_age = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] max_logfile_count = 30 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] max_logfile_size_mb = 200 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] max_over_subscription_ratio = 20.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] message_reap_interval = 86400 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] message_ttl = 2592000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] migration_create_volume_timeout_secs = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] monkey_patch = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] monkey_patch_modules = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] my_ip = 192.168.122.246 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] no_snapshot_gb_quota = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] num_iser_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] num_shell_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] num_volume_device_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] nvmeof_conn_info_version = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] nvmet_ns_id = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] nvmet_port_id = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_max_limit = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_volume_ext_list = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_volume_listen_port = 8776 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_volume_use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] osapi_volume_workers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] per_volume_size_limit = -1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] periodic_fuzzy_delay = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] periodic_interval = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] public_endpoint = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] publish_errors = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_backup_gigabytes = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_backups = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_gigabytes = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_groups = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_snapshots = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] quota_volumes = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] rate_limit_burst = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] rate_limit_except_level = CRITICAL {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] rate_limit_interval = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] reinit_driver_count = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] replication_device = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] report_discard_supported = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] report_interval = 120 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] reservation_clean_interval = 86400 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] reservation_expire = 86400 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] reserved_image_namespaces = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] reserved_percentage = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] rpc_response_timeout = 120 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] run_external_periodic_tasks = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] scst_target_driver = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] scst_target_iqn_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_down_time = 720 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] shell_completion = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] snapshot_name_template = snapshot-%s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] snapshot_same_host = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] state_path = /opt/stack/data/cinder {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] storage_availability_zone = nova {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] storage_protocol = iSCSI {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] syslog_log_facility = LOG_USER {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] target_helper = lioadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] target_ip_address = 192.168.122.246 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] target_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] target_protocol = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] target_secondary_ip_addresses = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] trace_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] transport_url = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] until_refresh = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_chap_auth = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_default_quota_class = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_journal = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_json = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_stderr = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] use_syslog = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] verify_glance_signatures = enabled {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_api_class = cinder.volume.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_backend_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_clear = zero {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_clear_ionice = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_clear_size = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_copy_bps_limit = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_dd_blocksize = 1M {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_name_template = volume-%s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_service_inithost_offload = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volume_usage_audit_period = month {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] zoning_mode = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_concurrency.disable_process_locking = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.auth_type = password {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.auth_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.cache = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.include_service_catalog = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.interface = public {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcache_username = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.region_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.service_type = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.backend = dogpile.cache.null {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.backend_argument = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.backend_expiration_time = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.config_prefix = cache.oslo {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.debug_cache_backend = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.enable_retry_client = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.enable_socket_keepalive = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.expiration_time = 600 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.hashclient_retry_attempts = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_dead_retry = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_pool_maxsize = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_sasl_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.proxies = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.redis_db = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.redis_server = localhost:6379 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.retry_attempts = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.retry_delay = 0.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.socket_keepalive_count = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.socket_keepalive_idle = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.socket_keepalive_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.socket_timeout = 1.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.tls_allowed_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.tls_cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.tls_certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.tls_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.tls_keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cache.username = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] coordination.backend_url = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.asyncio_connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.asyncio_slave_connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.backend = sqlalchemy {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.connection_debug = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.connection_parameters = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.connection_recycle_time = 3600 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.connection_trace = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.db_inc_retry_interval = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.db_max_retries = 20 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.db_max_retry_interval = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.db_retry_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.max_overflow = 50 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.max_pool_size = 5 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.max_retries = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.mysql_wsrep_sync_wait = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.pool_timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.retry_interval = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.slave_connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.sqlite_synchronous = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.synchronous_reader = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] database.use_db_reconnect = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_tracing.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.connection_string = messaging:// {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.es_doc_type = notification {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.es_scroll_size = 10000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.es_scroll_time = 2m {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.filter_error_trace = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.hmac_keys = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.sentinel_service_name = mymaster {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.socket_timeout = 0.1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.trace_requests = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler.trace_sqlalchemy = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler_jaeger.process_tags = {} {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler_jaeger.service_name_prefix = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] profiler_otlp.service_name_prefix = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.enforce_new_defaults = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.policy_default_rule = default {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.policy_file = policy.yaml {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.group = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.helper_command = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] privsep_osbrick.user = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.group = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.helper_command = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] cinder_sys_admin.user = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.auth_type = password {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.send_service_user_token = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] service_user.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.auth_type = password {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.region_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] glance.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.backend_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.chap_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.chap_username = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.disk_geometry = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.driver_client_cert = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.driver_client_cert_key = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.driver_data_namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.driver_use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.extra_capabilities = {} {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.filter_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.goodness_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.iscsi_target_flags = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.iscsi_write_cache = on {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.iser_helper = tgtadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.iser_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.lvm_share_target = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.lvm_type = auto {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.num_shell_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.replication_device = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.report_discard_supported = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.reserved_percentage = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.target_helper = tgtadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.target_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.target_protocol = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.trace_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.unique_fqdn_network = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.use_chap_auth = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_backend_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_clear = zero {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_clear_ionice = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_clear_size = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_reports.file_event_handler = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_reports.log_dir = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.backend_host = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.chap_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.chap_username = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.disk_geometry = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.driver_client_cert = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.extra_capabilities = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.filter_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.goodness_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.iser_helper = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.iser_ip_address = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.iser_port = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.lvm_share_target = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.lvm_type = auto {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.num_shell_tries = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.replication_device = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.report_discard_supported = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.reserved_percentage = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.scst_target_driver = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.storage_protocol = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.target_helper = lioadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.target_ip_address = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.target_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.trace_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.use_chap_auth = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_clear = zero {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_clear_size = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack sudo[76020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] lvmdriver-1.volumes_dir = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack sudo[76020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_notifications.driver = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_notifications.retry = -1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] key_manager.fixed_key = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.barbican_api_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.barbican_endpoint = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.barbican_endpoint_type = public {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.barbican_region_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.number_of_retries = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.retry_delay = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.send_service_user_token = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.verify_ssl = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican.verify_ssl_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.auth_type = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] barbican_service_user.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.approle_role_id = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.approle_secret_id = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.auth_method = approle {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.auth_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.kv_mountpoint = secret {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.kv_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.kv_version = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.root_token_id = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.ssl_ca_crt_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.timeout = 60.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.token_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.token_role = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:28:43 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] ******************************************************************************** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:28:43 devstack sudo[76020]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:43 devstack sudo[76023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:43 devstack sudo[76023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:44 devstack sudo[76023]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.274s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:28:44 devstack cinder-volume[76015]: INFO cinder.brick.local_dev.lvm [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:44 devstack sudo[76123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:28:44 devstack sudo[76123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:44 devstack sudo[76123]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG cinder.brick.local_dev.lvm [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76015) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 10:28:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:44 devstack sudo[76227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:44 devstack sudo[76227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:45 devstack sudo[76227]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.602s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:45 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:45 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:45 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:45 devstack sudo[76512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 10:28:45 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:45 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:45 devstack sudo[76609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:28:45 devstack sudo[76609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:45 devstack sudo[76609]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:45 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:45 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:28:45 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:46 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:46 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:46 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:46 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:46 devstack sudo[76726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:46 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:46 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:46 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:46 devstack sudo[76744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:46 devstack sudo[76744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:47 devstack sudo[76744]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:47 devstack cinder-volume[76015]: INFO cinder.volume.drivers.lvm [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:47 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:47 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:47 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:47 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:28:47 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:47 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:47 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:47 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:47 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:47 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:48 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:48 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:48 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:48 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:48 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:48 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:48 devstack cinder-volume[76015]: INFO cinder.volume.driver [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG cinder.volume.driver [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76015) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_db.sqlalchemy.engines [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writer thread running {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG cinder.db.api [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Building query based on filter {{(pid=76015) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG cinder.image.image_utils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76015) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:28:48 devstack cinder-volume[76015]: INFO cinder.keymgr.migration [None req-b121e026-cfb4-497f-a3d0-e800e2886c19 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:48 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:28:48 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:48 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:48 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:48 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:48 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:49 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:49 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:49 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:49 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:49 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:49 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:49 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:28:49 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Driver initialization completed successfully. Nov 02 10:28:49 devstack cinder-volume[76015]: INFO cinder.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Initiating service 2 cleanup Nov 02 10:28:49 devstack cinder-volume[76015]: INFO cinder.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Service 2 cleanup completed. Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG cinder.service [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Creating RPC server for service cinder-volume {{(pid=76015) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG cinder.service [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76015) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:28:49 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:28:49 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:49 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:28:49 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:50 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:50 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:50 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:50 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:50 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:50 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:50 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:50 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:50 devstack sudo[76864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:28:50 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:50 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:50 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:50 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:28:50 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:28:50 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:28:51 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Nov 02 10:28:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:28:51 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-90afeff2-56d0-4920-80ab-998686d6ffca None None] Driver post RPC initialization completed successfully. Nov 02 10:28:53 devstack cinder-volume[75861]: DEBUG dbcounter [-] [75861] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75861) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:29:01 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=4 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:29:01 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:29:43 devstack sudo[78757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:29:43 devstack sudo[78757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:29:43 devstack sudo[78757]: pam_unix(sudo:session): session closed for user root Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:29:43 devstack sudo[78760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:29:43 devstack sudo[78760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:29:43 devstack sudo[78760]: pam_unix(sudo:session): session closed for user root Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:29:43 devstack sudo[78763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:29:43 devstack sudo[78763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:29:43 devstack sudo[78763]: pam_unix(sudo:session): session closed for user root Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:29:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:29:43 devstack sudo[78766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:29:43 devstack sudo[78766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:29:44 devstack sudo[78766]: pam_unix(sudo:session): session closed for user root Nov 02 10:29:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:29:44 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:29:44 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:29:44 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:29:44 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] thread info: [<_MainThread(MainThread, started 139720885461120)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:30:43 devstack sudo[82066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:30:43 devstack sudo[82066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:30:43 devstack sudo[82066]: pam_unix(sudo:session): session closed for user root Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:30:43 devstack sudo[82074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:30:43 devstack sudo[82074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:30:43 devstack sudo[82074]: pam_unix(sudo:session): session closed for user root Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:30:43 devstack sudo[82081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:30:43 devstack sudo[82081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:30:43 devstack sudo[82081]: pam_unix(sudo:session): session closed for user root Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:30:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:30:43 devstack sudo[82091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:30:43 devstack sudo[82091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:30:44 devstack sudo[82091]: pam_unix(sudo:session): session closed for user root Nov 02 10:30:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:30:44 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:31:01 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:31:01 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:UPDATE=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:31:43 devstack sudo[84150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:31:43 devstack sudo[84150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:31:43 devstack sudo[84150]: pam_unix(sudo:session): session closed for user root Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:31:43 devstack sudo[84159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:31:43 devstack sudo[84159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:31:43 devstack sudo[84159]: pam_unix(sudo:session): session closed for user root Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:31:43 devstack sudo[84168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:31:43 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:31:43 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:31:43 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:31:43 devstack sudo[84185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:31:43 devstack sudo[84185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:31:44 devstack sudo[84185]: pam_unix(sudo:session): session closed for user root Nov 02 10:31:44 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:31:44 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:31:44 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:31:44 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:31:44 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] thread info: [<_MainThread(MainThread, started 139720885461120)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:32:43 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:32:43 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:32:43 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-0fd7b91b-4864-4422-9983-fba54500ec04 None None] thread info: [<_MainThread(MainThread, started 139720885461120)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:33:01 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:33:07 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Caught SIGTERM, stopping children Nov 02 10:33:07 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Acquiring lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:07 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Acquired lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:07 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Releasing lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:07 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Stop services. {{(pid=75861) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:33:07 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Killing children. {{(pid=75861) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:33:07 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Waiting on 1 children to exit Nov 02 10:33:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Acquiring lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Acquired lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Releasing lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:09 devstack cinder-volume[76015]: WARNING amqp [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:33:09 devstack cinder-volume[76015]: WARNING amqp [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:33:09 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-bcf678b0-2960-44d0-a03d-6bf09c628021 None None] Child 76015 exited with status 0 Nov 02 10:33:10 devstack cinder-volume[86041]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:33:10 devstack cinder-volume[86041]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:33:10 devstack cinder-volume[86041]: we strongly recommend against using it for new projects. Nov 02 10:33:10 devstack cinder-volume[86041]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:33:10 devstack cinder-volume[86041]: framework. For more detail see Nov 02 10:33:10 devstack cinder-volume[86041]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:33:10 devstack cinder-volume[86041]: import eventlet # noqa Nov 02 10:33:12 devstack cinder-volume[86041]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:12 devstack cinder-volume[86041]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:12 devstack cinder-volume[86041]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:13 devstack cinder-volume[86041]: INFO dbcounter [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Registered counter for database cinder Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_db.sqlalchemy.engines [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86041) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG dbcounter [-] [86041] Writer thread running {{(pid=86041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:33:13 devstack cinder-volume[86041]: INFO cinder.rpc [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:33:13 devstack cinder-volume[86041]: INFO cinder.rpc [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_db.sqlalchemy.engines [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86041) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:13 devstack cinder-volume[86041]: INFO cinder.volume.manager [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Determined volume DB was empty at startup. Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG cinder.volume.manager [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86041) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:33:13 devstack cinder-volume[86041]: INFO cinder.volume.manager [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:33:13 devstack cinder-volume[86041]: WARNING stevedore.named [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:33:13 devstack cinder-volume[86041]: WARNING castellan.key_manager [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:13 devstack cinder-volume[86041]: WARNING cinder.keymgr.conf_key_mgr [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:13 devstack cinder-volume[86041]: INFO cinder.volume.manager [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_db.sqlalchemy.engines [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86041) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:13 devstack cinder-volume[86041]: INFO oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Starting 1 workers Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Started child 86264 {{(pid=86041) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Full set of CONF: {{(pid=86041) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] ******************************************************************************** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Configuration options gathered from: {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] ================================================================================ {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] allow_availability_zone_fallback = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] allow_compression_on_image_upload = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] allowed_direct_url_schemes = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] api_rate_limit = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86264]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] auth_strategy = keystone {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_availability_zone = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_host = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_stats_polling_interval = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backup_api_class = cinder.backup.api.API {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backup_name_template = backup-%s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backup_use_same_host = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backup_use_temp_snapshot = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] chap_password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] chap_username = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_internal_tenant_project_id = 9c11947838034ce9a01d4e44e65d692a {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_internal_tenant_user_id = a49a53df8cb749d3b8c07e716adecde6 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cluster = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] compression_format = gzip {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] compute_api_class = cinder.compute.nova.API {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] config_dir = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] config_source = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] control_exchange = openstack {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] debug = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] default_availability_zone = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] default_group_type = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] default_volume_type = QuobyteHD {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] disk_geometry = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] driver_client_cert = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] driver_client_cert_key = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] driver_data_namespace = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] driver_ssl_cert_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] driver_ssl_cert_verify = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] driver_use_ssl = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] enable_new_services = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] enable_unsupported_driver = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] enabled_backends = ['QuobyteHD'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] enforce_multipath_for_image_xfer = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] filter_function = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_api_insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_api_ssl_compression = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_ca_certificates_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_catalog_info = image:glance:publicURL {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_num_retries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance_request_timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] goodness_function = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] graceful_shutdown_timeout = 5 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] group_api_class = cinder.group.api.API {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] host = devstack {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_compress_on_upload = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_conversion_address_space_limit = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_conversion_cpu_limit = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_conversion_disable = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_introspection_address_space_limit = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_introspection_cpu_limit = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_upload_use_cinder_backend = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_upload_use_internal_tenant = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_volume_cache_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_volume_cache_max_count = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] image_volume_cache_max_size_gb = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] init_host_max_objects_retrieval = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] instance_format = [instance: %(uuid)s] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] iscsi_target_flags = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] iscsi_write_cache = on {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] iser_helper = tgtadm {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] iser_ip_address = 192.168.122.246 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] iser_port = 3260 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_color = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_config_append = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:33:13 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.remotefs [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86264) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_dir = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_options = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_rotate_interval = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_rotate_interval_type = days {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] log_rotation_type = none {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] max_age = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] max_logfile_count = 30 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] max_logfile_size_mb = 200 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] max_over_subscription_ratio = 20.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] message_reap_interval = 86400 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] message_ttl = 2592000 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] migration_create_volume_timeout_secs = 300 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] monkey_patch = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] monkey_patch_modules = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] my_ip = 192.168.122.246 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] no_snapshot_gb_quota = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] num_iser_scan_tries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] num_shell_tries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] num_volume_device_scan_tries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] nvmeof_conn_info_version = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] nvmet_ns_id = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] nvmet_port_id = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_max_limit = 1000 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_volume_ext_list = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_volume_listen_port = 8776 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_volume_use_ssl = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] osapi_volume_workers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] per_volume_size_limit = -1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] periodic_fuzzy_delay = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] periodic_interval = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] public_endpoint = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] publish_errors = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_backup_gigabytes = 1000 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_backups = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_gigabytes = 1000 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_groups = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_snapshots = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] quota_volumes = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] rate_limit_burst = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] rate_limit_except_level = CRITICAL {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] rate_limit_interval = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] reinit_driver_count = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] replication_device = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] report_discard_supported = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] report_interval = 120 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] reservation_clean_interval = 86400 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] reservation_expire = 86400 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] reserved_image_namespaces = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] reserved_percentage = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] rpc_response_timeout = 120 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] run_external_periodic_tasks = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] scst_target_driver = iscsi {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] scst_target_iqn_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_down_time = 720 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] shell_completion = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] snapshot_name_template = snapshot-%s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] split_loggers = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] state_path = /opt/stack/data/cinder {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] storage_availability_zone = nova {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] storage_protocol = iSCSI {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] syslog_log_facility = LOG_USER {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] target_helper = lioadm {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] target_ip_address = 192.168.122.246 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] target_port = 3260 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] target_protocol = iscsi {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] target_secondary_ip_addresses = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] trace_flags = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] transport_url = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] until_refresh = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_chap_auth = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_default_quota_class = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_journal = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_json = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_multipath_for_image_xfer = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_stderr = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] use_syslog = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] verify_glance_signatures = enabled {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_api_class = cinder.volume.api.API {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_backend_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_clear = zero {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_clear_ionice = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_clear_size = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_copy_bps_limit = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_dd_blocksize = 1M {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_name_template = volume-%s {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_service_inithost_offload = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volume_usage_audit_period = month {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] zoning_mode = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_concurrency.disable_process_locking = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.auth_section = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.auth_type = password {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.auth_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.cache = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.include_service_catalog = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.interface = public {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcache_username = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.region_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.service_type = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.backend = dogpile.cache.null {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.backend_argument = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.backend_expiration_time = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.config_prefix = cache.oslo {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.debug_cache_backend = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.enable_retry_client = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.enable_socket_keepalive = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.expiration_time = 600 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.hashclient_retry_attempts = 2 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_dead_retry = 300 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:13 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86264) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:33:13 devstack cinder-volume[86264]: WARNING cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:33:14 devstack cinder-volume[86264]: WARNING cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_pool_maxsize = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_sasl_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Running cmd (subprocess): mount.quobyte {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.proxies = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.redis_db = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.redis_server = localhost:6379 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.retry_attempts = 2 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.retry_delay = 0.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.socket_keepalive_count = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.socket_keepalive_idle = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.socket_keepalive_interval = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.socket_timeout = 1.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.tls_allowed_ciphers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.tls_cafile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.tls_certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.tls_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.tls_keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cache.username = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] coordination.backend_url = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.asyncio_connection = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.asyncio_slave_connection = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.backend = sqlalchemy {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.connection = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.connection_debug = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.connection_parameters = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.connection_recycle_time = 3600 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.connection_trace = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.db_inc_retry_interval = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.db_max_retries = 20 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.db_max_retry_interval = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.db_retry_interval = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.max_overflow = 50 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.max_pool_size = 5 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.max_retries = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.mysql_wsrep_sync_wait = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.pool_timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.retry_interval = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.slave_connection = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.sqlite_synchronous = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.synchronous_reader = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] database.use_db_reconnect = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_tracing.insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.connection_string = messaging:// {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.es_doc_type = notification {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.es_scroll_size = 10000 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.es_scroll_time = 2m {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.filter_error_trace = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.hmac_keys = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.sentinel_service_name = mymaster {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.socket_timeout = 0.1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.trace_requests = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler.trace_sqlalchemy = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler_jaeger.process_tags = {} {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler_jaeger.service_name_prefix = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] profiler_otlp.service_name_prefix = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.enforce_new_defaults = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.policy_default_rule = default {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.policy_file = policy.yaml {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.group = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.helper_command = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] privsep_osbrick.user = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.group = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.helper_command = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] cinder_sys_admin.user = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.auth_section = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.auth_type = password {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.cafile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.collect_timing = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.send_service_user_token = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.split_loggers = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.tls_ciphers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] service_user.tls_min_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.auth_section = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.auth_type = password {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.collect_timing = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.region_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.split_loggers = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.tls_ciphers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] glance.tls_min_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.backend_availability_zone = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.chap_password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.chap_username = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.disk_geometry = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.driver_client_cert = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.driver_client_cert_key = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.driver_data_namespace = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.driver_use_ssl = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.extra_capabilities = {} {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.filter_function = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.goodness_function = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.iscsi_target_flags = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.iscsi_write_cache = on {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.iser_helper = tgtadm {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.iser_port = 3260 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_host = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_login = admin {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_mount_options = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_private_key = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_share_path = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.num_shell_tries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.quobyte_volume_url = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.replication_device = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.report_discard_supported = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.reserved_percentage = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.target_helper = tgtadm {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.target_port = 3260 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.target_protocol = iscsi {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.trace_flags = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.unique_fqdn_network = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.use_chap_auth = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_backend_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_clear = zero {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_clear_ionice = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_clear_size = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_reports.file_event_handler = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_reports.log_dir = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.backend_availability_zone = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.backend_host = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.chap_password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.chap_username = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.chiscsi_conf = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.disk_geometry = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.driver_client_cert = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.driver_data_namespace = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.driver_use_ssl = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.extra_capabilities = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.filter_function = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.goodness_function = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.iser_helper = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.iser_ip_address = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.iser_port = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.iser_target_prefix = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_host = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_login = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_mount_options = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_password = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_private_key = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_share_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_ssh_port = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.num_shell_tries = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.nvmet_port_id = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.replication_device = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.report_discard_supported = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.reserved_percentage = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.scst_target_driver = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.storage_protocol = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.target_helper = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.target_ip_address = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.target_port = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.target_prefix = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.target_protocol = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.trace_flags = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.use_chap_auth = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_clear = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_clear_size = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] QuobyteHD.volumes_dir = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_notifications.driver = [] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_notifications.retry = -1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] key_manager.fixed_key = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack quobyte-client[86268]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.barbican_api_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.barbican_endpoint = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.barbican_endpoint_type = public {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.barbican_region_name = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.cafile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack quobyte-client[86268]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.collect_timing = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.number_of_retries = 60 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.retry_delay = 1 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.send_service_user_token = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.split_loggers = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.tls_ciphers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.tls_min_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.verify_ssl = True {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican.verify_ssl_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.auth_section = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.auth_type = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.cafile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.certfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.collect_timing = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.insecure = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.keyfile = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.split_loggers = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.timeout = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.tls_ciphers = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] barbican_service_user.tls_min_version = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.approle_role_id = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.approle_secret_id = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.auth_method = approle {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.auth_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.kv_mountpoint = secret {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.kv_path = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.kv_version = 2 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.namespace = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.root_token_id = **** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.ssl_ca_crt_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] CMD "mount.quobyte" returned: 1 in 0.144s {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.timeout = 60.0 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.token_file = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.token_role = None {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.use_ssl = False {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:14 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] ******************************************************************************** {{(pid=86041) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:33:14 devstack cinder-volume[86264]: INFO cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 ... Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b -c /etc/quobyte/client-cinder.cfg {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:14 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b -c /etc/quobyte/client-cinder.cfg Nov 02 10:33:14 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:14 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.484s {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:14 devstack cinder-volume[86264]: INFO cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 succeeded Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.501s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:14 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:14 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:14 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.249s {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:14 devstack cinder-volume[86264]: INFO cinder.volume.driver [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG cinder.volume.driver [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8625526428223, 'free_capacity_gb': 1773.8625526428223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86264) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:33:14 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG dbcounter [-] [86264] Writer thread running {{(pid=86264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.db.api [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Building query based on filter {{(pid=86264) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.image.image_utils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86264) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:33:15 devstack cinder-volume[86264]: INFO cinder.keymgr.migration [None req-c0f21c3f-c2cb-4387-80f8-9df5f9c164fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:15 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:15 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:15 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.236s {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Notifying Schedulers of capabilities ... {{(pid=86264) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:33:15 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Driver initialization completed successfully. Nov 02 10:33:15 devstack cinder-volume[86264]: INFO cinder.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Initiating service 3 cleanup Nov 02 10:33:15 devstack cinder-volume[86264]: INFO cinder.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Service 3 cleanup completed. Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.service [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Creating RPC server for service cinder-volume {{(pid=86264) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.service [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86264) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:33:15 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:15 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:15 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:15 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:15 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.257s {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:15 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-a9d49056-c85d-4fba-b7ba-e25e5bd5d52d None None] Driver post RPC initialization completed successfully. Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG cinder.volume.drivers.quobyte [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86264) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:20 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:20 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:20 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG oslo_concurrency.processutils [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.230s {{(pid=86264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:20 devstack cinder-volume[86264]: DEBUG cinder.manager [None req-09fe02f7-6cd4-4419-8356-eb64aad33514 None None] Notifying Schedulers of capabilities ... {{(pid=86264) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:33:21 devstack cinder-volume[86041]: INFO oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Caught SIGTERM, stopping children Nov 02 10:33:21 devstack cinder-volume[86041]: DEBUG oslo_concurrency.lockutils [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Acquiring lock "singleton_lock" {{(pid=86041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:21 devstack cinder-volume[86041]: DEBUG oslo_concurrency.lockutils [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Acquired lock "singleton_lock" {{(pid=86041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:21 devstack cinder-volume[86041]: DEBUG oslo_concurrency.lockutils [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Releasing lock "singleton_lock" {{(pid=86041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:21 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Stop services. {{(pid=86041) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:33:21 devstack cinder-volume[86041]: DEBUG oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Killing children. {{(pid=86041) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:33:21 devstack cinder-volume[86041]: INFO oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Waiting on 1 children to exit Nov 02 10:33:23 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Acquiring lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:23 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Acquired lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:23 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Releasing lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:23 devstack cinder-volume[86264]: WARNING amqp [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:33:23 devstack cinder-volume[86264]: WARNING amqp [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:33:23 devstack cinder-volume[86041]: INFO oslo_service.backend._eventlet.service [None req-abb0e2d5-672a-4365-871d-26b7550d0e72 None None] Child 86264 exited with status 0 Nov 02 10:33:24 devstack cinder-volume[86617]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:33:24 devstack cinder-volume[86617]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:33:24 devstack cinder-volume[86617]: we strongly recommend against using it for new projects. Nov 02 10:33:24 devstack cinder-volume[86617]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:33:24 devstack cinder-volume[86617]: framework. For more detail see Nov 02 10:33:24 devstack cinder-volume[86617]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:33:24 devstack cinder-volume[86617]: import eventlet # noqa Nov 02 10:33:27 devstack cinder-volume[86617]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:27 devstack cinder-volume[86617]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:27 devstack cinder-volume[86617]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:28 devstack cinder-volume[86617]: INFO dbcounter [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Registered counter for database cinder Nov 02 10:33:28 devstack cinder-volume[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:28 devstack cinder-volume[86617]: DEBUG dbcounter [-] [86617] Writer thread running {{(pid=86617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:33:28 devstack cinder-volume[86617]: INFO cinder.rpc [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:33:28 devstack cinder-volume[86617]: INFO cinder.rpc [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:29 devstack cinder-volume[86617]: INFO cinder.volume.manager [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Determined volume DB was empty at startup. Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG cinder.volume.manager [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86617) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:33:29 devstack cinder-volume[86617]: WARNING stevedore.named [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:33:29 devstack cinder-volume[86617]: WARNING castellan.key_manager [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:29 devstack cinder-volume[86617]: WARNING cinder.keymgr.conf_key_mgr [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:29 devstack cinder-volume[86617]: INFO cinder.volume.manager [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:29 devstack cinder-volume[86617]: INFO oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Starting 1 workers Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Started child 86926 {{(pid=86617) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Full set of CONF: {{(pid=86617) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] ******************************************************************************** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] Configuration options gathered from: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] ================================================================================ {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] allow_availability_zone_fallback = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] allow_compression_on_image_upload = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] allowed_direct_url_schemes = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86926]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] api_rate_limit = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] auth_strategy = keystone {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_host = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_stats_polling_interval = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backup_api_class = cinder.backup.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backup_name_template = backup-%s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backup_use_same_host = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backup_use_temp_snapshot = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] chap_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] chap_username = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_internal_tenant_project_id = 9c11947838034ce9a01d4e44e65d692a {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_internal_tenant_user_id = a49a53df8cb749d3b8c07e716adecde6 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cluster = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] compression_format = gzip {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] compute_api_class = cinder.compute.nova.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] config_dir = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] config_source = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] control_exchange = openstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] debug = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] default_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] default_group_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] default_volume_type = QuobyteHD {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] disk_geometry = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] driver_client_cert = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] driver_client_cert_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] driver_data_namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] driver_ssl_cert_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] driver_ssl_cert_verify = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] driver_use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] enable_new_services = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] enable_unsupported_driver = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] enabled_backends = ['QuobyteHD'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] enforce_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] filter_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_api_insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_api_ssl_compression = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_ca_certificates_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_catalog_info = image:glance:publicURL {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_num_retries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance_request_timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] goodness_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] graceful_shutdown_timeout = 5 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] group_api_class = cinder.group.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] host = devstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_compress_on_upload = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_conversion_address_space_limit = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_conversion_cpu_limit = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_conversion_disable = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_introspection_address_space_limit = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_introspection_cpu_limit = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_upload_use_cinder_backend = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_upload_use_internal_tenant = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_volume_cache_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_volume_cache_max_count = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] image_volume_cache_max_size_gb = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] init_host_max_objects_retrieval = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] instance_format = [instance: %(uuid)s] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] iscsi_target_flags = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] iscsi_write_cache = on {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] iser_helper = tgtadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] iser_ip_address = 192.168.122.246 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] iser_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_color = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_config_append = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_dir = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_options = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_rotate_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_rotate_interval_type = days {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] log_rotation_type = none {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] max_age = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] max_logfile_count = 30 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] max_logfile_size_mb = 200 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] max_over_subscription_ratio = 20.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] message_reap_interval = 86400 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] message_ttl = 2592000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] migration_create_volume_timeout_secs = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] monkey_patch = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] monkey_patch_modules = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] my_ip = 192.168.122.246 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] no_snapshot_gb_quota = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] num_iser_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] num_shell_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] num_volume_device_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] nvmeof_conn_info_version = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] nvmet_ns_id = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] nvmet_port_id = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_max_limit = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_volume_ext_list = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_volume_listen_port = 8776 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_volume_use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] osapi_volume_workers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] per_volume_size_limit = -1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] periodic_fuzzy_delay = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] periodic_interval = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] public_endpoint = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] publish_errors = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_backup_gigabytes = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_backups = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_gigabytes = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_groups = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_snapshots = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] quota_volumes = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] rate_limit_burst = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] rate_limit_except_level = CRITICAL {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] rate_limit_interval = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] reinit_driver_count = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] replication_device = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] report_discard_supported = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] report_interval = 120 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] reservation_clean_interval = 86400 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] reservation_expire = 86400 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] reserved_image_namespaces = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] reserved_percentage = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] rpc_response_timeout = 120 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] run_external_periodic_tasks = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] scst_target_driver = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] scst_target_iqn_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_down_time = 720 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] shell_completion = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] snapshot_name_template = snapshot-%s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] state_path = /opt/stack/data/cinder {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] storage_availability_zone = nova {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] storage_protocol = iSCSI {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] syslog_log_facility = LOG_USER {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] target_helper = lioadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] target_ip_address = 192.168.122.246 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] target_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] target_protocol = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] target_secondary_ip_addresses = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] trace_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] transport_url = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] until_refresh = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_chap_auth = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_default_quota_class = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_journal = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_json = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_stderr = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] use_syslog = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] verify_glance_signatures = enabled {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_api_class = cinder.volume.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_backend_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_clear = zero {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_clear_ionice = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_clear_size = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_copy_bps_limit = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_dd_blocksize = 1M {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_name_template = volume-%s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_service_inithost_offload = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volume_usage_audit_period = month {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] zoning_mode = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_concurrency.disable_process_locking = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.auth_type = password {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.auth_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.cache = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.include_service_catalog = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.interface = public {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86926) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcache_username = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.region_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.service_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.backend = dogpile.cache.null {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.backend_argument = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.backend_expiration_time = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.config_prefix = cache.oslo {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.debug_cache_backend = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.enable_retry_client = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.enable_socket_keepalive = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.expiration_time = 600 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.hashclient_retry_attempts = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_dead_retry = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_pool_maxsize = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_sasl_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.proxies = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.redis_db = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.redis_server = localhost:6379 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.retry_attempts = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.retry_delay = 0.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.socket_keepalive_count = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.socket_keepalive_idle = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.socket_keepalive_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.socket_timeout = 1.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.tls_allowed_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.tls_cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.tls_certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.tls_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.tls_keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cache.username = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] coordination.backend_url = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.asyncio_connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.asyncio_slave_connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.backend = sqlalchemy {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.connection_debug = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.connection_parameters = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.connection_recycle_time = 3600 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.connection_trace = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.db_inc_retry_interval = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.db_max_retries = 20 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.db_max_retry_interval = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.db_retry_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.max_overflow = 50 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.max_pool_size = 5 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.max_retries = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.mysql_wsrep_sync_wait = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.pool_timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.retry_interval = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.slave_connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.sqlite_synchronous = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.synchronous_reader = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] database.use_db_reconnect = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_tracing.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.connection_string = messaging:// {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.es_doc_type = notification {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.es_scroll_size = 10000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.es_scroll_time = 2m {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.filter_error_trace = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.hmac_keys = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.sentinel_service_name = mymaster {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.socket_timeout = 0.1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.trace_requests = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler.trace_sqlalchemy = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler_jaeger.process_tags = {} {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler_jaeger.service_name_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] profiler_otlp.service_name_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.enforce_new_defaults = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.policy_default_rule = default {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.policy_file = policy.yaml {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.group = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.helper_command = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] privsep_osbrick.user = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.group = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.helper_command = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] cinder_sys_admin.user = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.auth_type = password {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.send_service_user_token = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] service_user.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.auth_type = password {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.region_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] glance.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.backend_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.chap_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.chap_username = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.disk_geometry = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.driver_client_cert = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.driver_client_cert_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.driver_data_namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.driver_use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.extra_capabilities = {} {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.filter_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.goodness_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.iscsi_target_flags = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.iscsi_write_cache = on {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.iser_helper = tgtadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.iser_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_host = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_login = admin {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_mount_options = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_private_key = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_share_path = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.num_shell_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.quobyte_volume_url = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.replication_device = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.report_discard_supported = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.reserved_percentage = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.target_helper = tgtadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.target_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.target_protocol = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.trace_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.unique_fqdn_network = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.use_chap_auth = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_backend_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_clear = zero {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_clear_ionice = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_clear_size = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_reports.file_event_handler = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_reports.log_dir = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.backend_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.backend_host = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.chap_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.chap_username = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.chiscsi_conf = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.disk_geometry = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.driver_client_cert = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.driver_data_namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.driver_use_ssl = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.extra_capabilities = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.filter_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.goodness_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.iser_helper = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.iser_ip_address = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.iser_port = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.iser_target_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_host = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_login = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_mount_options = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_private_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_share_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_ssh_port = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.num_shell_tries = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.nvmet_port_id = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.replication_device = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.report_discard_supported = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.reserved_percentage = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.scst_target_driver = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.storage_protocol = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.target_helper = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.target_ip_address = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.target_port = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.target_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.target_protocol = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.trace_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.use_chap_auth = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_clear = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_clear_size = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] QuobyteHD.volumes_dir = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86926) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:33:29 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:33:29 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_notifications.driver = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_notifications.retry = -1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] key_manager.fixed_key = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.barbican_api_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.barbican_endpoint = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.barbican_endpoint_type = public {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.barbican_region_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.number_of_retries = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.retry_delay = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.send_service_user_token = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.verify_ssl = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican.verify_ssl_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.auth_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] barbican_service_user.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.approle_role_id = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.approle_secret_id = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.auth_method = approle {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.auth_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.kv_mountpoint = secret {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.kv_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.kv_version = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.root_token_id = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.ssl_ca_crt_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.timeout = 60.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.token_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.token_role = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:29 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-493b4a0a-fe65-447e-bcfa-e5ebfa6c1804 None None] ******************************************************************************** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:33:29 devstack quobyte-client[86927]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:33:29 devstack quobyte-client[86927]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:29 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:29 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:29 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.229s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:29 devstack cinder-volume[86926]: INFO cinder.volume.driver [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.driver [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8625526428223, 'free_capacity_gb': 1773.8625526428223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86926) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_db.sqlalchemy.engines [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86926) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writer thread running {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.db.api [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Building query based on filter {{(pid=86926) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86926) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:29 devstack cinder-volume[86926]: INFO cinder.keymgr.migration [None req-6151d0fe-36cd-47bb-9a22-b4df443d0a69 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:33:29 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:29 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:30 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.229s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:33:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Driver initialization completed successfully. Nov 02 10:33:30 devstack cinder-volume[86926]: INFO cinder.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Initiating service 3 cleanup Nov 02 10:33:30 devstack cinder-volume[86926]: INFO cinder.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Service 3 cleanup completed. Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG cinder.service [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Creating RPC server for service cinder-volume {{(pid=86926) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG cinder.service [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86926) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:33:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:30 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:33:30 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:30 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-03c3095e-b9a4-4705-8ddd-140530b0b0a2 None None] Driver post RPC initialization completed successfully. Nov 02 10:33:39 devstack cinder-volume[86617]: DEBUG dbcounter [-] [86617] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:33:39 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:33:40 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:34:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:34:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 6 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:34:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Flow 'volume_create_manager' (f6f54f5e-4ecb-4c5c-8829-6da85d5b16ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e209c1-e172-48fc-8c13-92104051e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e209c1-e172-48fc-8c13-92104051e58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-715969756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e1cb6e-741b-4098-9c56-1c9d1a612d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf77669055b42c7bc03acfdb06206ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:34:44Z,use_quota=True,user_id='a6c4b0d74e8a4842804af1fd9df6c7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1adbfb20-b72b-4f58-8cc2-5f9bf5e95f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1adbfb20-b72b-4f58-8cc2-5f9bf5e95f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c0dc3f-14f9-427e-9e36-65e5719474c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c0dc3f-14f9-427e-9e36-65e5719474c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e1cb6e-741b-4098-9c56-1c9d1a612d38', 'volume_name': 'volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4378ec-14c7-4977-81b5-8620021daab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4378ec-14c7-4977-81b5-8620021daab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6cc4aa-5c0a-49dd-9235-083ecf491f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Volume e6e1cb6e-741b-4098-9c56-1c9d1a612d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38', 'volume_size': 1} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-715969756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e1cb6e-741b-4098-9c56-1c9d1a612d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf77669055b42c7bc03acfdb06206ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:34:44Z,use_quota=True,user_id='a6c4b0d74e8a4842804af1fd9df6c7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Creating volume e6e1cb6e-741b-4098-9c56-1c9d1a612d38 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:34:44 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:34:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:44 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 1073741824 Nov 02 10:34:44 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:46 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 1073741824" returned: 0 in 1.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:46 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 Nov 02 10:34:46 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:46 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38" returned: 0 in 0.609s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6cc4aa-5c0a-49dd-9235-083ecf491f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91cfc84-e6af-4c84-989a-ad6e656f5bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Volume volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 (e6e1cb6e-741b-4098-9c56-1c9d1a612d38): created successfully Nov 02 10:34:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91cfc84-e6af-4c84-989a-ad6e656f5bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Flow 'volume_create_manager' (f6f54f5e-4ecb-4c5c-8829-6da85d5b16ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:34:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7b657b74-7462-4f22-a838-f5e96fb270ca tempest-DeleteServersTestJSON-210265951 None] Created volume successfully. Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Flow 'volume_create_manager' (3a6e249d-38dc-4b09-b3c3-d03a65d5b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4728528c-20b6-45a9-aabe-64e06f5ff9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4728528c-20b6-45a9-aabe-64e06f5ff9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1505866880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabcbc19-436c-4aa3-b155-695e8ec17ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b401df19018f431eb02a49ad8215dc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:34:50Z,use_quota=True,user_id='5b36761ee8434db0be167a58c61aa3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1d732-82b9-4b59-9e31-7362531c7bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1d732-82b9-4b59-9e31-7362531c7bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc519317-fe0e-4781-98e1-fd82b0dda4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc519317-fe0e-4781-98e1-fd82b0dda4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabcbc19-436c-4aa3-b155-695e8ec17ba0', 'volume_name': 'volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4d3921-cdd2-4bf6-b258-a8ef6e470fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4d3921-cdd2-4bf6-b258-a8ef6e470fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a03c0a5-b08e-49c5-b333-c738a2d67a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:50 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Volume aabcbc19-436c-4aa3-b155-695e8ec17ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0', 'volume_size': 1} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1505866880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabcbc19-436c-4aa3-b155-695e8ec17ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b401df19018f431eb02a49ad8215dc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:34:50Z,use_quota=True,user_id='5b36761ee8434db0be167a58c61aa3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Creating volume aabcbc19-436c-4aa3-b155-695e8ec17ba0 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:34:50 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:34:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:50 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 1073741824 Nov 02 10:34:50 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:51 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 1073741824" returned: 0 in 1.039s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:51 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 Nov 02 10:34:51 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:52 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a03c0a5-b08e-49c5-b333-c738a2d67a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b88538-b319-4dee-8be2-01174d897889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:34:52 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Volume volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 (aabcbc19-436c-4aa3-b155-695e8ec17ba0): created successfully Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b88538-b319-4dee-8be2-01174d897889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:34:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Flow 'volume_create_manager' (3a6e249d-38dc-4b09-b3c3-d03a65d5b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:34:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2c8a0ce2-e35b-4bb0-84f7-632ad401fb0e tempest-VolumesAdminNegativeTest-700412296 None] Created volume successfully. Nov 02 10:34:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Acquiring lock "cinder-aabcbc19-436c-4aa3-b155-695e8ec17ba0-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:34:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Lock "cinder-aabcbc19-436c-4aa3-b155-695e8ec17ba0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:34:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Acquiring lock "cinder-quobyte-aabcbc19-436c-4aa3-b155-695e8ec17ba0" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:34:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Lock "cinder-quobyte-aabcbc19-436c-4aa3-b155-695e8ec17ba0" acquired by "delete_volume" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:34:53 devstack cinder-volume[86926]: INFO oslo.privsep.daemon [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpo7jvhb04/privsep.sock'] Nov 02 10:34:53 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpo7jvhb04/privsep.sock Nov 02 10:34:53 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:54 devstack cinder-volume[86926]: WARNING py.warnings [req-c7e7050e-3203-42d9-aef1-862c87bf36fb req-a9112c40-66f7-4862-a84c-d25635f1c576 tempest-DeleteServersTestJSON-210265951 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 02 10:34:54 devstack cinder-volume[86926]: .first() Nov 02 10:34:54 devstack cinder-volume[86926]: Nov 02 10:34:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c7e7050e-3203-42d9-aef1-862c87bf36fb req-a9112c40-66f7-4862-a84c-d25635f1c576 tempest-DeleteServersTestJSON-210265951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:34:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c7e7050e-3203-42d9-aef1-862c87bf36fb req-a9112c40-66f7-4862-a84c-d25635f1c576 tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:34:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c7e7050e-3203-42d9-aef1-862c87bf36fb req-a9112c40-66f7-4862-a84c-d25635f1c576 tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:34:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-c7e7050e-3203-42d9-aef1-862c87bf36fb req-a9112c40-66f7-4862-a84c-d25635f1c576 tempest-DeleteServersTestJSON-210265951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51ffe310-eaa7-48ce-8a6c-89b4820d2b54', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:34:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-c7e7050e-3203-42d9-aef1-862c87bf36fb req-a9112c40-66f7-4862-a84c-d25635f1c576 tempest-DeleteServersTestJSON-210265951 None] attachment_update completed successfully. Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:34:55 devstack cinder-volume[86926]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 10:34:56 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:56 devstack cinder-volume[86926]: INFO oslo.privsep.daemon [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Spawned new privsep daemon via rootwrap Nov 02 10:34:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Accepted privsep connection to /tmp/tmpo7jvhb04/privsep.sock {{(pid=86926) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 10:34:56 devstack cinder-volume[86926]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 10:34:56 devstack cinder-volume[86926]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 10:34:56 devstack cinder-volume[86926]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 10:34:56 devstack cinder-volume[86926]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88156 Nov 02 10:34:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13e8e2-9d90-4f0e-bb34-49f64f2e1268]: (2,) {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:34:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6530fb3-b6a4-4b6c-8d47-85ebb13b4149]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:34:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:56 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 Nov 02 10:34:56 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:57 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0" returned: 0 in 0.951s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:57 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0 Nov 02 10:34:57 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:57 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aabcbc19-436c-4aa3-b155-695e8ec17ba0" returned: 0 in 0.539s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Lock "cinder-quobyte-aabcbc19-436c-4aa3-b155-695e8ec17ba0" released by "delete_volume" :: held 4.156s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:34:57 devstack cinder-volume[86926]: WARNING cinder.quota [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:34:57 devstack cinder-volume[86926]: WARNING cinder.quota [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:34:57 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Created reservations ['092eaa18-15c4-4827-8408-88bba3328143', '13cf7aa9-5713-4862-8ac0-2aacfeed4d9e', 'f4633cbc-3aed-4bcc-9366-ba2490257ac8', '19df5f4b-d997-4b5e-a805-372207514a70'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:58 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:34:58 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:58 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.842s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:58 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:34:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Deleted volume successfully. Nov 02 10:34:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c587cc7-b841-4f5d-a5b8-5f82acb28343 tempest-VolumesAdminNegativeTest-700412296 None] Lock "cinder-aabcbc19-436c-4aa3-b155-695e8ec17ba0-delete_volume" released by "delete_volume" :: held 5.543s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:35:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-fe6a7695-2d72-4768-98fa-b80bd01ec051 req-a3317a05-cc41-48d0-9c4d-34fbca05c293 tempest-DeleteServersTestJSON-210265951 None] Terminate volume connection completed successfully. Nov 02 10:35:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-fe6a7695-2d72-4768-98fa-b80bd01ec051 req-a3317a05-cc41-48d0-9c4d-34fbca05c293 tempest-DeleteServersTestJSON-210265951 None] Deleting attachment 51ffe310-eaa7-48ce-8a6c-89b4820d2b54. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:35:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Acquiring lock "cinder-e6e1cb6e-741b-4098-9c56-1c9d1a612d38-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:35:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Lock "cinder-e6e1cb6e-741b-4098-9c56-1c9d1a612d38-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:35:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Acquiring lock "cinder-quobyte-e6e1cb6e-741b-4098-9c56-1c9d1a612d38" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:35:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Lock "cinder-quobyte-e6e1cb6e-741b-4098-9c56-1c9d1a612d38" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:35:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5504a92e-03b7-478d-8f7c-c4c3455f9083]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:35:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:02 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 Nov 02 10:35:02 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:03 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38" returned: 0 in 0.398s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:03 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38 Nov 02 10:35:03 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:03 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e6e1cb6e-741b-4098-9c56-1c9d1a612d38" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Lock "cinder-quobyte-e6e1cb6e-741b-4098-9c56-1c9d1a612d38" released by "delete_volume" :: held 0.734s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Created reservations ['67c49a9a-50bb-41d5-b225-7436dfca5c95', 'd5fb50f4-b4b8-47fd-b415-7fbf1f77bb99', '09b47b27-e99f-4296-a22e-21b14c673d71', 'c78aeaf5-49a3-48cb-99ce-99632fbcf9d2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:03 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:35:03 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:03 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.290s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:35:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Deleted volume successfully. Nov 02 10:35:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-79649f55-a357-48c8-9ba8-9bdd15be0c62 tempest-DeleteServersTestJSON-210265951 None] Lock "cinder-e6e1cb6e-741b-4098-9c56-1c9d1a612d38-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Flow 'volume_create_manager' (1a8f102c-43f6-4130-a65c-6e93554d8b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8ed4ee-6c59-453e-8536-4824756d0cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8ed4ee-6c59-453e-8536-4824756d0cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1419101612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22994966-1b63-4f9b-a2b9-9f3d5e8644b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6117d9e7d64a8886c57528af6e28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:35:13Z,use_quota=True,user_id='842ae4c619f541e5bac64827a5403454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab34c43-d89a-4486-9f61-68f409016d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab34c43-d89a-4486-9f61-68f409016d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6239e2-cfc2-4ee9-96d9-ae6ce19bf430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6239e2-cfc2-4ee9-96d9-ae6ce19bf430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22994966-1b63-4f9b-a2b9-9f3d5e8644b7', 'volume_name': 'volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802b0c7e-13bc-4112-bd2c-26d8ebf6fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802b0c7e-13bc-4112-bd2c-26d8ebf6fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7b6c53-2f98-438d-a647-a25aab937487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:13 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Volume 22994966-1b63-4f9b-a2b9-9f3d5e8644b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7', 'volume_size': 1} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1419101612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22994966-1b63-4f9b-a2b9-9f3d5e8644b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6117d9e7d64a8886c57528af6e28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:35:13Z,use_quota=True,user_id='842ae4c619f541e5bac64827a5403454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Creating volume 22994966-1b63-4f9b-a2b9-9f3d5e8644b7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:35:13 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:35:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:13 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 1073741824 Nov 02 10:35:13 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:14 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 1073741824" returned: 0 in 0.596s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:14 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 Nov 02 10:35:14 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:14 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7" returned: 0 in 0.320s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7b6c53-2f98-438d-a647-a25aab937487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4077e1b3-6a7a-46e7-8bf6-914c62aebcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:14 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Volume volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 (22994966-1b63-4f9b-a2b9-9f3d5e8644b7): created successfully Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4077e1b3-6a7a-46e7-8bf6-914c62aebcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Flow 'volume_create_manager' (1a8f102c-43f6-4130-a65c-6e93554d8b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:35:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dc5f255c-373e-4477-86a3-4f87e0d2ac4d tempest-AttachVolumeTestJSON-1058856336 None] Created volume successfully. Nov 02 10:35:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-f870804f-722c-4af9-afbe-2d824faf823c req-feb30b5c-cfe7-4878-85b4-38550d597d8a tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-f870804f-722c-4af9-afbe-2d824faf823c req-feb30b5c-cfe7-4878-85b4-38550d597d8a tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-f870804f-722c-4af9-afbe-2d824faf823c req-feb30b5c-cfe7-4878-85b4-38550d597d8a tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-f870804f-722c-4af9-afbe-2d824faf823c req-feb30b5c-cfe7-4878-85b4-38550d597d8a tempest-AttachVolumeTestJSON-1058856336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7ac80dc-cf44-4927-a507-b0c87261ba43', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:35:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-f870804f-722c-4af9-afbe-2d824faf823c req-feb30b5c-cfe7-4878-85b4-38550d597d8a tempest-AttachVolumeTestJSON-1058856336 None] attachment_update completed successfully. Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:22 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:35:22 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:22 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 8 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:35:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:35:26 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=30,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:35:26 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=30,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:35:40 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:35:40 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Flow 'volume_create_manager' (f9d49a6e-eeed-4c56-89b2-fe1c1a9eba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7cfaad-cf69-4ec8-8bc0-efb91cdf5f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7cfaad-cf69-4ec8-8bc0-efb91cdf5f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1896080094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f3db0b-db2a-4822-82ed-c4b4492db4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b3c1ce43ea4a3fbd184929d9dc136f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:35:57Z,use_quota=True,user_id='c5ca5e967edc4010899ced60503e5560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087c3b96-605a-49ba-984f-b8bf8b63a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087c3b96-605a-49ba-984f-b8bf8b63a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9a45b3-0e65-4305-af94-3ab58a53ebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9a45b3-0e65-4305-af94-3ab58a53ebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f3db0b-db2a-4822-82ed-c4b4492db4bc', 'volume_name': 'volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56abf1b3-a378-490b-a356-d5baac650da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56abf1b3-a378-490b-a356-d5baac650da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e684fe70-6d03-4828-a5eb-d852d4b1347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Volume e1f3db0b-db2a-4822-82ed-c4b4492db4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc', 'volume_size': 1} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1896080094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f3db0b-db2a-4822-82ed-c4b4492db4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b3c1ce43ea4a3fbd184929d9dc136f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:35:57Z,use_quota=True,user_id='c5ca5e967edc4010899ced60503e5560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Creating volume e1f3db0b-db2a-4822-82ed-c4b4492db4bc {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:35:57 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:35:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:57 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc 1073741824 Nov 02 10:35:58 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:58 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc 1073741824" returned: 0 in 1.037s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:59 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc Nov 02 10:35:59 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:59 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc" returned: 0 in 0.713s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e684fe70-6d03-4828-a5eb-d852d4b1347f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d7f0e4-0eeb-4cc1-af8a-81ca98115b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:35:59 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Volume volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc (e1f3db0b-db2a-4822-82ed-c4b4492db4bc): created successfully Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d7f0e4-0eeb-4cc1-af8a-81ca98115b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:35:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Flow 'volume_create_manager' (f9d49a6e-eeed-4c56-89b2-fe1c1a9eba64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:35:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-95a43985-ca4f-487e-9a87-61a09a125f72 tempest-TaggedAttachmentsTest-1259098771 None] Created volume successfully. Nov 02 10:36:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-62e9f453-b008-4311-86a0-6902cd7354a2 req-8808c7b2-9706-45d1-bbb3-4f000085e29b tempest-AttachVolumeTestJSON-1058856336 None] Terminate volume connection completed successfully. Nov 02 10:36:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-62e9f453-b008-4311-86a0-6902cd7354a2 req-8808c7b2-9706-45d1-bbb3-4f000085e29b tempest-AttachVolumeTestJSON-1058856336 None] Deleting attachment e7ac80dc-cf44-4927-a507-b0c87261ba43. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Flow 'volume_create_manager' (c7a018e4-1f2d-4a7e-ab37-6d6f2cd8e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1625ad-ad81-45d9-a03e-5888992ab225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1625ad-ad81-45d9-a03e-5888992ab225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2093332096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b73974-e65f-4685-b39d-f5eea090e022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08586579a779441aa2da9b330301f2bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:36:07Z,use_quota=True,user_id='12f32f8c981147a68fb0f812b3111294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ca48d7-3dcf-49ad-9b38-180697172bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ca48d7-3dcf-49ad-9b38-180697172bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8044306-c8d8-4a91-a94c-d4e3d3d1461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8044306-c8d8-4a91-a94c-d4e3d3d1461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b73974-e65f-4685-b39d-f5eea090e022', 'volume_name': 'volume-b0b73974-e65f-4685-b39d-f5eea090e022', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5b1864-2c41-4393-a15f-def93c356b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5b1864-2c41-4393-a15f-def93c356b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a2623c-c1ff-477b-92dd-4f98490df24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:36:07 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Volume b0b73974-e65f-4685-b39d-f5eea090e022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b73974-e65f-4685-b39d-f5eea090e022', 'volume_size': 1} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2093332096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b73974-e65f-4685-b39d-f5eea090e022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08586579a779441aa2da9b330301f2bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:36:07Z,use_quota=True,user_id='12f32f8c981147a68fb0f812b3111294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Creating volume b0b73974-e65f-4685-b39d-f5eea090e022 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:36:07 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:36:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:07 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 1073741824 Nov 02 10:36:07 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:08 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 1073741824" returned: 0 in 1.100s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:08 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 Nov 02 10:36:08 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:09 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022" returned: 0 in 0.674s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a2623c-c1ff-477b-92dd-4f98490df24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b73974-e65f-4685-b39d-f5eea090e022', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65134c5-5c51-4c2f-82d4-b86ffe2d572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:36:09 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Volume volume-b0b73974-e65f-4685-b39d-f5eea090e022 (b0b73974-e65f-4685-b39d-f5eea090e022): created successfully Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65134c5-5c51-4c2f-82d4-b86ffe2d572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:36:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Flow 'volume_create_manager' (c7a018e4-1f2d-4a7e-ab37-6d6f2cd8e711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:36:09 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-24c6e7af-ad8c-4b47-a154-8edb4799523d tempest-ServerRescueNegativeTestJSON-312355753 None] Created volume successfully. Nov 02 10:36:19 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:INSERT=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:36:19 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:36:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:22 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:36:22 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:23 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.490s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:36:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Acquiring lock "cinder-b0b73974-e65f-4685-b39d-f5eea090e022-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "cinder-b0b73974-e65f-4685-b39d-f5eea090e022-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Acquiring lock "cinder-quobyte-b0b73974-e65f-4685-b39d-f5eea090e022" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "cinder-quobyte-b0b73974-e65f-4685-b39d-f5eea090e022" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2c3741-2d17-4176-ab52-5196c4ee573b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:32 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 Nov 02 10:36:32 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:32 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022" returned: 0 in 0.456s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:32 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022 Nov 02 10:36:32 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:32 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b0b73974-e65f-4685-b39d-f5eea090e022" returned: 0 in 0.251s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "cinder-quobyte-b0b73974-e65f-4685-b39d-f5eea090e022" released by "delete_volume" :: held 0.787s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:36:32 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Created reservations ['fbf51651-c38e-4b59-9f8e-a0aa6b8329dd', 'e513451c-03d5-4543-aea3-a73bd3d3c7fc', 'fbda814b-e588-4f49-9a66-cfdadd11c60b', '7905f25f-0ba0-48cf-9a41-5d54e8266fbe'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:33 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:36:33 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:33 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.399s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:36:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Deleted volume successfully. Nov 02 10:36:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d8b7a036-34c1-4df3-abb7-cadcd20db6fb tempest-ServerRescueNegativeTestJSON-312355753 None] Lock "cinder-b0b73974-e65f-4685-b39d-f5eea090e022-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:36:43 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=2 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:36:43 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Flow 'volume_create_manager' (61fb7091-f3e3-4a09-b7b9-910859d3d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394a62d3-a391-4d1b-ac05-9ff68e436c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394a62d3-a391-4d1b-ac05-9ff68e436c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-686733113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e86944-baa9-42ce-9ef0-c1e20b6e07db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce8df8898c43788735d25d2958e699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:04Z,use_quota=True,user_id='ebaa777cdd7540edaee92394043f3e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29126d50-899c-4ecd-b452-7f2bb461ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29126d50-899c-4ecd-b452-7f2bb461ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfbdebb-dda4-49e6-b71f-804b0d792597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfbdebb-dda4-49e6-b71f-804b0d792597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e86944-baa9-42ce-9ef0-c1e20b6e07db', 'volume_name': 'volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1450cde-d4fc-4125-ae98-e906a7191863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1450cde-d4fc-4125-ae98-e906a7191863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba38dbe-2c52-49af-89c9-20de2d249fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Volume 43e86944-baa9-42ce-9ef0-c1e20b6e07db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db', 'volume_size': 1} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-686733113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e86944-baa9-42ce-9ef0-c1e20b6e07db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce8df8898c43788735d25d2958e699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:04Z,use_quota=True,user_id='ebaa777cdd7540edaee92394043f3e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Creating volume 43e86944-baa9-42ce-9ef0-c1e20b6e07db {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:37:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:37:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:04 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db 1073741824 Nov 02 10:37:04 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:05 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db 1073741824" returned: 0 in 0.954s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:05 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db Nov 02 10:37:05 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:06 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db" returned: 0 in 0.397s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba38dbe-2c52-49af-89c9-20de2d249fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62740950-4324-432c-af60-f572cb8908cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Volume volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db (43e86944-baa9-42ce-9ef0-c1e20b6e07db): created successfully Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62740950-4324-432c-af60-f572cb8908cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Flow 'volume_create_manager' (61fb7091-f3e3-4a09-b7b9-910859d3d324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-649bc45c-2fba-4dfb-bd93-16461575443e tempest-ServerActionsTestOtherA-1127498219 None] Created volume successfully. Nov 02 10:37:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-5bd450a5-8960-45c0-bbbd-3de4e6f7b2c9 req-de518e40-6e5c-49df-aeca-cbda229672a4 tempest-TaggedAttachmentsTest-1259098771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-5bd450a5-8960-45c0-bbbd-3de4e6f7b2c9 req-de518e40-6e5c-49df-aeca-cbda229672a4 tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-5bd450a5-8960-45c0-bbbd-3de4e6f7b2c9 req-de518e40-6e5c-49df-aeca-cbda229672a4 tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-5bd450a5-8960-45c0-bbbd-3de4e6f7b2c9 req-de518e40-6e5c-49df-aeca-cbda229672a4 tempest-TaggedAttachmentsTest-1259098771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f5b995e-4dcb-4ff9-bd98-72a41cd7b026', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:37:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-5bd450a5-8960-45c0-bbbd-3de4e6f7b2c9 req-de518e40-6e5c-49df-aeca-cbda229672a4 tempest-TaggedAttachmentsTest-1259098771 None] attachment_update completed successfully. Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:22 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:37:22 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-1a916afc-53dc-4417-afba-b36a78220bb1 req-9063f6d4-5870-4e6f-8146-3a18be817d88 tempest-TaggedAttachmentsTest-1259098771 None] Terminate volume connection completed successfully. Nov 02 10:37:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-1a916afc-53dc-4417-afba-b36a78220bb1 req-9063f6d4-5870-4e6f-8146-3a18be817d88 tempest-TaggedAttachmentsTest-1259098771 None] Deleting attachment 4f5b995e-4dcb-4ff9-bd98-72a41cd7b026. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:37:23 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.754s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:37:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:37:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 8 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:37:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:37:25 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Flow 'volume_create_manager' (6435b829-5ea4-4bd0-aba0-2554356ac19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd400a7-76dd-4c42-9b4a-4f5928e94664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd400a7-76dd-4c42-9b4a-4f5928e94664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-679713125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17189772-a2c1-4785-801e-d15585e354ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be6298fc43549498df2a2e9585ab3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:38Z,use_quota=True,user_id='881a03029ccb496ebb194d16227e2c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50369e01-e3e5-43b3-a385-375f87c62a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50369e01-e3e5-43b3-a385-375f87c62a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcfc650-17d6-44a7-9181-47517c059274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcfc650-17d6-44a7-9181-47517c059274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17189772-a2c1-4785-801e-d15585e354ef', 'volume_name': 'volume-17189772-a2c1-4785-801e-d15585e354ef', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1877e0-87f1-4ef7-8a8b-affad628f9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1877e0-87f1-4ef7-8a8b-affad628f9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14da2d7-e086-46c1-8a1a-490b329cca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:38 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Volume 17189772-a2c1-4785-801e-d15585e354ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17189772-a2c1-4785-801e-d15585e354ef', 'volume_size': 1} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-679713125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17189772-a2c1-4785-801e-d15585e354ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be6298fc43549498df2a2e9585ab3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:38Z,use_quota=True,user_id='881a03029ccb496ebb194d16227e2c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Creating volume 17189772-a2c1-4785-801e-d15585e354ef {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:37:38 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:38 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef 1073741824 Nov 02 10:37:38 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Acquiring lock "cinder-e1f3db0b-db2a-4822-82ed-c4b4492db4bc-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Lock "cinder-e1f3db0b-db2a-4822-82ed-c4b4492db4bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Acquiring lock "cinder-quobyte-e1f3db0b-db2a-4822-82ed-c4b4492db4bc" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Lock "cinder-quobyte-e1f3db0b-db2a-4822-82ed-c4b4492db4bc" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c391eab-9a3e-4bb0-9290-41c3278a9252]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:37:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:38 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc Nov 02 10:37:38 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:39 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef 1073741824" returned: 0 in 0.604s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:39 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef Nov 02 10:37:39 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:39 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc" returned: 0 in 0.530s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:39 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc Nov 02 10:37:39 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:39 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef" returned: 0 in 0.412s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:39 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14da2d7-e086-46c1-8a1a-490b329cca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17189772-a2c1-4785-801e-d15585e354ef', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3622c497-7a25-42a3-8dbb-e234f556bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e1f3db0b-db2a-4822-82ed-c4b4492db4bc" returned: 0 in 0.351s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Lock "cinder-quobyte-e1f3db0b-db2a-4822-82ed-c4b4492db4bc" released by "delete_volume" :: held 0.953s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:37:39 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Volume volume-17189772-a2c1-4785-801e-d15585e354ef (17189772-a2c1-4785-801e-d15585e354ef): created successfully Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3622c497-7a25-42a3-8dbb-e234f556bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Flow 'volume_create_manager' (6435b829-5ea4-4bd0-aba0-2554356ac19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-728f619a-68b8-49dd-b863-b5e5d9cd4594 tempest-ServersNegativeTestJSON-1955459619 None] Created volume successfully. Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Created reservations ['d6ee9d26-d746-41f4-b168-34617526f2a0', 'fe6b1c2b-aac0-4298-9b61-3d408bf4e400', 'e0c29d42-5c26-4639-9d59-9ac67008f356', '581cccb4-59c9-4d0c-adfa-1356864c2a6e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:40 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:37:40 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Flow 'volume_create_manager' (dfaa3099-d61b-4655-91da-2ad4498449ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda0bbf9-fd16-44f0-8912-947e47b94a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda0bbf9-fd16-44f0-8912-947e47b94a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2002945970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656bbe6b-ed14-46dc-a4fe-ab379ca0c8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6117d9e7d64a8886c57528af6e28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:40Z,use_quota=True,user_id='842ae4c619f541e5bac64827a5403454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3811179d-b827-4e73-8302-b00b24197ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3811179d-b827-4e73-8302-b00b24197ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2960f2b-c164-4e82-a736-dd13e2121e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2960f2b-c164-4e82-a736-dd13e2121e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656bbe6b-ed14-46dc-a4fe-ab379ca0c8af', 'volume_name': 'volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddbca75-953f-4688-a9f2-9e99669ebd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddbca75-953f-4688-a9f2-9e99669ebd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b54b6ef-d312-4de9-b920-4b7e9322f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Volume 656bbe6b-ed14-46dc-a4fe-ab379ca0c8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af', 'volume_size': 1} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2002945970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656bbe6b-ed14-46dc-a4fe-ab379ca0c8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6117d9e7d64a8886c57528af6e28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:40Z,use_quota=True,user_id='842ae4c619f541e5bac64827a5403454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Creating volume 656bbe6b-ed14-46dc-a4fe-ab379ca0c8af {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:37:40 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:40 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af 1073741824 Nov 02 10:37:40 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:40 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:37:40 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Deleted volume successfully. Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-73083fb6-9f62-4ab6-bcf7-286e2fe6f20f tempest-TaggedAttachmentsTest-1259098771 None] Lock "cinder-e1f3db0b-db2a-4822-82ed-c4b4492db4bc-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:37:40 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af 1073741824" returned: 0 in 0.460s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:40 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af Nov 02 10:37:40 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:40 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af" returned: 0 in 0.257s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b54b6ef-d312-4de9-b920-4b7e9322f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65074da2-e6ff-4067-bcd5-7fcffd402421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Volume volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af (656bbe6b-ed14-46dc-a4fe-ab379ca0c8af): created successfully Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65074da2-e6ff-4067-bcd5-7fcffd402421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Flow 'volume_create_manager' (dfaa3099-d61b-4655-91da-2ad4498449ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:40 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-63f96eb0-cd51-4e3a-8748-46eefca54de2 tempest-AttachVolumeTestJSON-1058856336 None] Created volume successfully. Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Flow 'volume_create_manager' (afcff03c-7bb3-4bb1-918d-732444d57b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d86de9-b820-44e8-b542-6282e1d2d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d86de9-b820-44e8-b542-6282e1d2d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1797471174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50748e72-262c-4af9-b434-53b129e5458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be6298fc43549498df2a2e9585ab3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:42Z,use_quota=True,user_id='881a03029ccb496ebb194d16227e2c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e960f7-c083-47c1-9498-7802e98e23b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e960f7-c083-47c1-9498-7802e98e23b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed1c0fb-a7ca-4d12-9e40-992de7633a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed1c0fb-a7ca-4d12-9e40-992de7633a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50748e72-262c-4af9-b434-53b129e5458b', 'volume_name': 'volume-50748e72-262c-4af9-b434-53b129e5458b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c6bedd-d11e-462a-8b56-26e0d9bb8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c6bedd-d11e-462a-8b56-26e0d9bb8b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d44b3a-0ac7-4ffb-b574-ef9f41f81179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Volume 50748e72-262c-4af9-b434-53b129e5458b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50748e72-262c-4af9-b434-53b129e5458b', 'volume_size': 1} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1797471174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50748e72-262c-4af9-b434-53b129e5458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be6298fc43549498df2a2e9585ab3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:42Z,use_quota=True,user_id='881a03029ccb496ebb194d16227e2c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Creating volume 50748e72-262c-4af9-b434-53b129e5458b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:37:41 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:41 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b 1073741824 Nov 02 10:37:41 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-eca6e09e-a812-4d49-86f6-3eed2a298af9 req-ce77d939-7133-4fcb-90d2-88b9b79ec042 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:42 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b 1073741824" returned: 0 in 0.469s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:42 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b Nov 02 10:37:42 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:42 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b" returned: 0 in 0.278s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-eca6e09e-a812-4d49-86f6-3eed2a298af9 req-ce77d939-7133-4fcb-90d2-88b9b79ec042 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.758s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d44b3a-0ac7-4ffb-b574-ef9f41f81179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50748e72-262c-4af9-b434-53b129e5458b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bb378c-3f9c-492b-bacb-5bd093f41970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-eca6e09e-a812-4d49-86f6-3eed2a298af9 req-ce77d939-7133-4fcb-90d2-88b9b79ec042 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:42 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Volume volume-50748e72-262c-4af9-b434-53b129e5458b (50748e72-262c-4af9-b434-53b129e5458b): created successfully Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bb378c-3f9c-492b-bacb-5bd093f41970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Flow 'volume_create_manager' (afcff03c-7bb3-4bb1-918d-732444d57b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b09ef857-9ffd-47d5-bc0b-09deab50a86f tempest-ServersNegativeTestJSON-1955459619 None] Created volume successfully. Nov 02 10:37:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-eca6e09e-a812-4d49-86f6-3eed2a298af9 req-ce77d939-7133-4fcb-90d2-88b9b79ec042 tempest-AttachVolumeTestJSON-1058856336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c4d1f0b-4e51-4e6b-96b5-3ba7ea108bfa', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:37:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-eca6e09e-a812-4d49-86f6-3eed2a298af9 req-ce77d939-7133-4fcb-90d2-88b9b79ec042 tempest-AttachVolumeTestJSON-1058856336 None] attachment_update completed successfully. Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "cinder-50748e72-262c-4af9-b434-53b129e5458b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-50748e72-262c-4af9-b434-53b129e5458b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "cinder-quobyte-50748e72-262c-4af9-b434-53b129e5458b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-quobyte-50748e72-262c-4af9-b434-53b129e5458b" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[95af3ec5-3adb-4f05-a7c7-513fd2ecc6e1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:44 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b Nov 02 10:37:44 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Flow 'volume_create_manager' (1bd17d7c-dc31-4067-8abb-934456114605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2d6e41-528c-42cf-8649-f89dee3557ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2d6e41-528c-42cf-8649-f89dee3557ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1919829363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2758c9cc-bfe6-4383-8639-a031faf6df1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6117d9e7d64a8886c57528af6e28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:45Z,use_quota=True,user_id='842ae4c619f541e5bac64827a5403454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c0b412-3cb5-4a96-a702-91ba4c097cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c0b412-3cb5-4a96-a702-91ba4c097cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9534925-1dea-43df-8400-3ba7ef1d8867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9534925-1dea-43df-8400-3ba7ef1d8867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2758c9cc-bfe6-4383-8639-a031faf6df1b', 'volume_name': 'volume-2758c9cc-bfe6-4383-8639-a031faf6df1b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29989e-9c5f-4cb2-907c-7ffde5da8396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29989e-9c5f-4cb2-907c-7ffde5da8396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbef60d-35a5-4ac3-8a77-f9b917a5412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Volume 2758c9cc-bfe6-4383-8639-a031faf6df1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2758c9cc-bfe6-4383-8639-a031faf6df1b', 'volume_size': 1} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1919829363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2758c9cc-bfe6-4383-8639-a031faf6df1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6117d9e7d64a8886c57528af6e28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:45Z,use_quota=True,user_id='842ae4c619f541e5bac64827a5403454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Creating volume 2758c9cc-bfe6-4383-8639-a031faf6df1b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:37:44 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:44 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b" returned: 0 in 0.548s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:44 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b 1073741824 Nov 02 10:37:44 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:44 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b Nov 02 10:37:44 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:45 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50748e72-262c-4af9-b434-53b129e5458b" returned: 0 in 0.273s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-quobyte-50748e72-262c-4af9-b434-53b129e5458b" released by "delete_volume" :: held 0.870s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Created reservations ['4ba93e6c-4319-4aa8-a839-14b6e9a591d1', 'dca6bfa6-5a9b-408a-ac3c-1f1d60057f3c', '1cebb80e-52cb-45e5-9c4f-94781ac2377c', '8d73d4e4-af2b-4600-a8d8-8dfe2be0c1c1'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:45 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:37:45 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:45 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b 1073741824" returned: 0 in 0.569s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "cinder-17189772-a2c1-4785-801e-d15585e354ef-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:37:45 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b Nov 02 10:37:45 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-17189772-a2c1-4785-801e-d15585e354ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "cinder-quobyte-17189772-a2c1-4785-801e-d15585e354ef" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:37:45 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:37:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Deleted volume successfully. Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-quobyte-17189772-a2c1-4785-801e-d15585e354ef" acquired by "delete_volume" :: waited 0.049s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df7aeefd-bbd1-4440-9f31-0a501af657db tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-50748e72-262c-4af9-b434-53b129e5458b-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa008a2-81fa-4f5b-8484-91472fc2eb5e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:45 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef Nov 02 10:37:45 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:45 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b" returned: 0 in 0.384s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbef60d-35a5-4ac3-8a77-f9b917a5412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2758c9cc-bfe6-4383-8639-a031faf6df1b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ceee6b-6f20-48bf-906b-a5964e78ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:45 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Volume volume-2758c9cc-bfe6-4383-8639-a031faf6df1b (2758c9cc-bfe6-4383-8639-a031faf6df1b): created successfully Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ceee6b-6f20-48bf-906b-a5964e78ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Flow 'volume_create_manager' (1bd17d7c-dc31-4067-8abb-934456114605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c939319c-0203-4a88-871a-73b1e1bb6036 tempest-AttachVolumeTestJSON-1058856336 None] Created volume successfully. Nov 02 10:37:45 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:45 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef Nov 02 10:37:45 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:46 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17189772-a2c1-4785-801e-d15585e354ef" returned: 0 in 0.272s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-quobyte-17189772-a2c1-4785-801e-d15585e354ef" released by "delete_volume" :: held 0.708s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Created reservations ['5b84e687-7d97-45b3-b300-763689127afe', '9c254d81-6511-49a8-9f40-f1e9f7353151', '3f916f65-c569-4175-9e26-9a4a32fa07e5', '0f7bb445-49a6-4bf6-a640-d26dc76623fb'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:46 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:37:46 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:46 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.410s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:37:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Deleted volume successfully. Nov 02 10:37:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e1ee2832-32f0-40aa-aa06-54b9b06f6bb8 tempest-ServersNegativeTestJSON-1955459619 None] Lock "cinder-17189772-a2c1-4785-801e-d15585e354ef-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:37:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-61dbbf81-3219-401c-873a-ee140b828234 req-50a5e87d-a018-477e-9553-49f0871d1ff2 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-61dbbf81-3219-401c-873a-ee140b828234 req-50a5e87d-a018-477e-9553-49f0871d1ff2 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-61dbbf81-3219-401c-873a-ee140b828234 req-50a5e87d-a018-477e-9553-49f0871d1ff2 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-61dbbf81-3219-401c-873a-ee140b828234 req-50a5e87d-a018-477e-9553-49f0871d1ff2 tempest-AttachVolumeTestJSON-1058856336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-2758c9cc-bfe6-4383-8639-a031faf6df1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '630c8db9-bd0f-4fc2-9988-2765f3b28a5e', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:37:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-61dbbf81-3219-401c-873a-ee140b828234 req-50a5e87d-a018-477e-9553-49f0871d1ff2 tempest-AttachVolumeTestJSON-1058856336 None] attachment_update completed successfully. Nov 02 10:37:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-0306af4e-27e6-4cd2-8f02-08482e85ffe7 req-48f95a19-108b-4d2c-84a0-58aeab54b4a5 tempest-AttachVolumeTestJSON-1058856336 None] Terminate volume connection completed successfully. Nov 02 10:37:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-0306af4e-27e6-4cd2-8f02-08482e85ffe7 req-48f95a19-108b-4d2c-84a0-58aeab54b4a5 tempest-AttachVolumeTestJSON-1058856336 None] Deleting attachment 6c4d1f0b-4e51-4e6b-96b5-3ba7ea108bfa. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:37:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-3b893d49-f0c1-42c4-86da-9a237482824f req-6e13d072-3c95-483a-8f30-ef663a753ce8 tempest-AttachVolumeTestJSON-1058856336 None] Terminate volume connection completed successfully. Nov 02 10:37:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-3b893d49-f0c1-42c4-86da-9a237482824f req-6e13d072-3c95-483a-8f30-ef663a753ce8 tempest-AttachVolumeTestJSON-1058856336 None] Deleting attachment 630c8db9-bd0f-4fc2-9988-2765f3b28a5e. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:37:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3eedcde4-5284-4286-9726-a1b6eac17687 req-567ceb1f-7888-4021-8b9f-b75e19683738 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3eedcde4-5284-4286-9726-a1b6eac17687 req-567ceb1f-7888-4021-8b9f-b75e19683738 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3eedcde4-5284-4286-9726-a1b6eac17687 req-567ceb1f-7888-4021-8b9f-b75e19683738 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-3eedcde4-5284-4286-9726-a1b6eac17687 req-567ceb1f-7888-4021-8b9f-b75e19683738 tempest-ServerActionsTestOtherA-1127498219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3e7fadd-6357-40a5-8112-4fce4cf20001', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:37:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-3eedcde4-5284-4286-9726-a1b6eac17687 req-567ceb1f-7888-4021-8b9f-b75e19683738 tempest-ServerActionsTestOtherA-1127498219 None] attachment_update completed successfully. Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Flow 'volume_create_manager' (c0467ce0-6a17-4f3d-96ea-7f8a5b3081ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c4f9da-16c2-4196-89c9-f54e2a06b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c4f9da-16c2-4196-89c9-f54e2a06b889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1736365823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e23de7f-3a55-4e87-b880-ba90f27caa9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fec267c0035f413cb5589abf444816fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:57Z,use_quota=True,user_id='0b58d6a0a9504a12bcb2e0f56b67c97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4dd6b8-c4d1-40cf-aa5d-90fdd96cf0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4dd6b8-c4d1-40cf-aa5d-90fdd96cf0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00501b89-f7b3-4edd-9494-fa2d25762433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00501b89-f7b3-4edd-9494-fa2d25762433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e23de7f-3a55-4e87-b880-ba90f27caa9f', 'volume_name': 'volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e5ebee-f1ef-4ea2-8044-b4bd6c3621bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e5ebee-f1ef-4ea2-8044-b4bd6c3621bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5253ca5c-c792-4d04-8316-ba6b3b556b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:56 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Volume 5e23de7f-3a55-4e87-b880-ba90f27caa9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f', 'volume_size': 1} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1736365823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e23de7f-3a55-4e87-b880-ba90f27caa9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fec267c0035f413cb5589abf444816fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:37:57Z,use_quota=True,user_id='0b58d6a0a9504a12bcb2e0f56b67c97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Creating volume 5e23de7f-3a55-4e87-b880-ba90f27caa9f {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:37:56 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:37:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:56 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f 1073741824 Nov 02 10:37:56 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:57 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f 1073741824" returned: 0 in 0.610s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:57 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f Nov 02 10:37:57 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:57 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5253ca5c-c792-4d04-8316-ba6b3b556b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67036d6f-89bc-408b-8400-fb3020ec8f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Volume volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f (5e23de7f-3a55-4e87-b880-ba90f27caa9f): created successfully Nov 02 10:37:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67036d6f-89bc-408b-8400-fb3020ec8f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Flow 'volume_create_manager' (c0467ce0-6a17-4f3d-96ea-7f8a5b3081ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a3c16f41-d202-4eda-a528-ee8c134518d0 tempest-VolumesTestJSON-358584712 None] Created volume successfully. Nov 02 10:37:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-efd80291-d6fc-4199-95af-8be42908f63b req-7ad8ac1f-01d1-43a4-bc5e-61cea2246329 tempest-ServerActionsTestOtherA-1127498219 None] Terminate volume connection completed successfully. Nov 02 10:37:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-efd80291-d6fc-4199-95af-8be42908f63b req-7ad8ac1f-01d1-43a4-bc5e-61cea2246329 tempest-ServerActionsTestOtherA-1127498219 None] Deleting attachment c3e7fadd-6357-40a5-8112-4fce4cf20001. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Flow 'volume_create_manager' (0b5c474f-53a0-4942-9e52-6690d85dd712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f73612-2172-4e38-9213-db15b64ab96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-efd80291-d6fc-4199-95af-8be42908f63b req-0a931b33-6fb8-4890-ab4b-a467cc34b22f tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-efd80291-d6fc-4199-95af-8be42908f63b req-0a931b33-6fb8-4890-ab4b-a467cc34b22f tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f73612-2172-4e38-9213-db15b64ab96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1720998284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071174ce-0dd3-416a-ae20-b712bc8f03a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fec267c0035f413cb5589abf444816fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:00Z,use_quota=True,user_id='0b58d6a0a9504a12bcb2e0f56b67c97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2242454b-72b7-49c3-9287-ee214f8afd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2242454b-72b7-49c3-9287-ee214f8afd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0839430a-1f33-4c5e-bd5d-865f3bc87183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0839430a-1f33-4c5e-bd5d-865f3bc87183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071174ce-0dd3-416a-ae20-b712bc8f03a8', 'volume_name': 'volume-071174ce-0dd3-416a-ae20-b712bc8f03a8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1abe26c-e1fa-4c5d-b021-517f1b1c29ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1abe26c-e1fa-4c5d-b021-517f1b1c29ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc434fe-fea8-4ec7-b462-ecdf9c195b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:37:59 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Volume 071174ce-0dd3-416a-ae20-b712bc8f03a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071174ce-0dd3-416a-ae20-b712bc8f03a8', 'volume_size': 1} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-efd80291-d6fc-4199-95af-8be42908f63b req-0a931b33-6fb8-4890-ab4b-a467cc34b22f tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1720998284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071174ce-0dd3-416a-ae20-b712bc8f03a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fec267c0035f413cb5589abf444816fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:00Z,use_quota=True,user_id='0b58d6a0a9504a12bcb2e0f56b67c97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Creating volume 071174ce-0dd3-416a-ae20-b712bc8f03a8 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:37:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:38:00 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:00 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 1073741824 Nov 02 10:38:00 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-efd80291-d6fc-4199-95af-8be42908f63b req-0a931b33-6fb8-4890-ab4b-a467cc34b22f tempest-ServerActionsTestOtherA-1127498219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '532bdd57-08c0-4bfc-b6a6-ba3ad7dba909', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:38:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-efd80291-d6fc-4199-95af-8be42908f63b req-0a931b33-6fb8-4890-ab4b-a467cc34b22f tempest-ServerActionsTestOtherA-1127498219 None] attachment_update completed successfully. Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "cinder-2758c9cc-bfe6-4383-8639-a031faf6df1b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-2758c9cc-bfe6-4383-8639-a031faf6df1b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "cinder-quobyte-2758c9cc-bfe6-4383-8639-a031faf6df1b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-quobyte-2758c9cc-bfe6-4383-8639-a031faf6df1b" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:00 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 1073741824" returned: 0 in 0.757s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae31234-2f38-4ea7-9965-efb978d3ac88]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:00 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 Nov 02 10:38:00 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:00 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b Nov 02 10:38:00 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:01 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8" returned: 0 in 0.335s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc434fe-fea8-4ec7-b462-ecdf9c195b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071174ce-0dd3-416a-ae20-b712bc8f03a8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978f60ea-9cce-4cd8-a196-c54db3cd6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Volume volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 (071174ce-0dd3-416a-ae20-b712bc8f03a8): created successfully Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978f60ea-9cce-4cd8-a196-c54db3cd6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Flow 'volume_create_manager' (0b5c474f-53a0-4942-9e52-6690d85dd712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1c106f58-130f-4fe8-a1e8-f76e87aeaf8c tempest-VolumesTestJSON-358584712 None] Created volume successfully. Nov 02 10:38:01 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b" returned: 0 in 0.518s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:01 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b Nov 02 10:38:01 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:01 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2758c9cc-bfe6-4383-8639-a031faf6df1b" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-quobyte-2758c9cc-bfe6-4383-8639-a031faf6df1b" released by "delete_volume" :: held 0.911s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Created reservations ['0a4429f2-4e2e-4bdb-876d-6d45e8569d10', '2292c78c-9843-494e-97dd-275cb9231f7e', 'af877a0f-41c1-4136-8d78-e988052e4e1f', '2b8bf115-1e5c-4eb2-bca3-81c59a7c4e9a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:01 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:01 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:02 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.493s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:02 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Deleted volume successfully. Nov 02 10:38:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b7e1ddb-1b69-47f7-82e7-ee4b0ebfa26e tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-2758c9cc-bfe6-4383-8639-a031faf6df1b-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "cinder-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "cinder-quobyte-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-quobyte-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af" acquired by "delete_volume" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9197c9-d76c-47bd-a4c8-d70046167c77]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:38:03 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Flow 'volume_create_manager' (295d4d34-83f5-4181-9ef2-a1a439a01831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:03 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba592a7-f661-438d-ad2f-6f9c9890eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba592a7-f661-438d-ad2f-6f9c9890eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1958590916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ec9024-191f-4ce5-be4d-b92e5778aaf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fec267c0035f413cb5589abf444816fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:03Z,use_quota=True,user_id='0b58d6a0a9504a12bcb2e0f56b67c97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeaf00c8-7fe8-4edf-a496-0573a7d6f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeaf00c8-7fe8-4edf-a496-0573a7d6f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccd90b4-1489-4550-a38a-d386d1be4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccd90b4-1489-4550-a38a-d386d1be4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ec9024-191f-4ce5-be4d-b92e5778aaf8', 'volume_name': 'volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0cd94a-d50a-4afc-a72e-43a6fc4f8b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0cd94a-d50a-4afc-a72e-43a6fc4f8b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198264ca-acff-4471-8e47-2f78003ae65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Volume a7ec9024-191f-4ce5-be4d-b92e5778aaf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8', 'volume_size': 1} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1958590916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ec9024-191f-4ce5-be4d-b92e5778aaf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fec267c0035f413cb5589abf444816fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:03Z,use_quota=True,user_id='0b58d6a0a9504a12bcb2e0f56b67c97d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Creating volume a7ec9024-191f-4ce5-be4d-b92e5778aaf8 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:38:03 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:03 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 1073741824 Nov 02 10:38:03 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:03 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af" returned: 0 in 0.524s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:03 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af Nov 02 10:38:03 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:04 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:04 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 1073741824" returned: 0 in 0.718s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-quobyte-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af" released by "delete_volume" :: held 1.097s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=74,cinder:UPDATE=64,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:04 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 Nov 02 10:38:04 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Created reservations ['87af8587-4b21-44a5-93d2-ad5c823f0d3c', 'c05d2036-5ff4-4815-9c1d-e0521e1ad9df', 'edad3c27-d3e4-453b-8f6f-9ff46dacf325', 'bba9c413-9b73-4bf1-83a7-c878c7bac33f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:04 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:04 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:04 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8" returned: 0 in 0.460s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198264ca-acff-4471-8e47-2f78003ae65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8effb564-fe0c-4806-8e42-178d6dc2f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Volume volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 (a7ec9024-191f-4ce5-be4d-b92e5778aaf8): created successfully Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8effb564-fe0c-4806-8e42-178d6dc2f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Flow 'volume_create_manager' (295d4d34-83f5-4181-9ef2-a1a439a01831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-940273ee-f3c8-4c58-8407-d679f9214642 tempest-VolumesTestJSON-358584712 None] Created volume successfully. Nov 02 10:38:04 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:04 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Deleted volume successfully. Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a499e769-fa96-445c-95e6-20c79f6f38f4 tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-656bbe6b-ed14-46dc-a4fe-ab379ca0c8af-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "cinder-22994966-1b63-4f9b-a2b9-9f3d5e8644b7-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-22994966-1b63-4f9b-a2b9-9f3d5e8644b7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "cinder-quobyte-22994966-1b63-4f9b-a2b9-9f3d5e8644b7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-quobyte-22994966-1b63-4f9b-a2b9-9f3d5e8644b7" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87285d-350c-4e6d-96ed-3a72ea5ca976]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:05 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 Nov 02 10:38:05 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:06 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7" returned: 0 in 0.643s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:06 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7 Nov 02 10:38:06 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:06 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-22994966-1b63-4f9b-a2b9-9f3d5e8644b7" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-quobyte-22994966-1b63-4f9b-a2b9-9f3d5e8644b7" released by "delete_volume" :: held 1.105s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Created reservations ['d4bce1fa-2975-4eb4-9223-a4d0a83eed5f', '79740c18-3722-4ea4-9cbd-032eb18b5d1d', 'af19b324-4374-471a-986d-cb43c6201c3f', 'b843379e-eddb-4a78-a4cc-349ea9b84f46'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Acquiring lock "cinder-a7ec9024-191f-4ce5-be4d-b92e5778aaf8-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:06 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:06 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Lock "cinder-a7ec9024-191f-4ce5-be4d-b92e5778aaf8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Acquiring lock "cinder-quobyte-a7ec9024-191f-4ce5-be4d-b92e5778aaf8" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Lock "cinder-quobyte-a7ec9024-191f-4ce5-be4d-b92e5778aaf8" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1253a1-8a76-424c-b828-45a3ff1fa006]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:07 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 Nov 02 10:38:07 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:07 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Deleted volume successfully. Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f1c367ab-7b08-44eb-8db7-2aef8eb614fb tempest-AttachVolumeTestJSON-1058856336 None] Lock "cinder-22994966-1b63-4f9b-a2b9-9f3d5e8644b7-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:07 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8" returned: 0 in 0.492s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:07 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8 Nov 02 10:38:07 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:08 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7ec9024-191f-4ce5-be4d-b92e5778aaf8" returned: 0 in 0.447s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Lock "cinder-quobyte-a7ec9024-191f-4ce5-be4d-b92e5778aaf8" released by "delete_volume" :: held 1.002s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Created reservations ['d20f2196-e60a-485e-ac98-cce3c98c3372', '0a5935c3-2891-4c3c-9bf0-47ebf2a32e53', 'fe67e7b7-ca9d-4b89-948d-f65921c207ad', '0cd77ab6-bdda-46b2-9f10-2be50f4b316b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:08 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:08 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:08 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.364s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Deleted volume successfully. Nov 02 10:38:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4911999f-03a9-4ca6-a7de-d5c98b38a313 tempest-VolumesTestJSON-358584712 None] Lock "cinder-a7ec9024-191f-4ce5-be4d-b92e5778aaf8-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Acquiring lock "cinder-071174ce-0dd3-416a-ae20-b712bc8f03a8-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Lock "cinder-071174ce-0dd3-416a-ae20-b712bc8f03a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Acquiring lock "cinder-quobyte-071174ce-0dd3-416a-ae20-b712bc8f03a8" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Lock "cinder-quobyte-071174ce-0dd3-416a-ae20-b712bc8f03a8" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93fe48-112a-436c-8da8-c75c859a2cb2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:09 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 Nov 02 10:38:09 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:10 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8" returned: 0 in 0.531s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:10 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8 Nov 02 10:38:10 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:10 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-071174ce-0dd3-416a-ae20-b712bc8f03a8" returned: 0 in 0.460s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Lock "cinder-quobyte-071174ce-0dd3-416a-ae20-b712bc8f03a8" released by "delete_volume" :: held 1.089s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Created reservations ['c4e4a200-70cf-42ff-864e-315811eaeec9', 'c5d857df-c6e2-4f40-801c-88d69e447024', 'cc4df68f-6260-43c6-9bb9-b67c0ef75c8f', 'c26e44a9-e616-4886-857a-39c6d14d6d41'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:10 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:10 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:11 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.498s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Deleted volume successfully. Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49efd412-e46b-47d0-80b4-43116be8081d tempest-VolumesTestJSON-358584712 None] Lock "cinder-071174ce-0dd3-416a-ae20-b712bc8f03a8-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Acquiring lock "cinder-5e23de7f-3a55-4e87-b880-ba90f27caa9f-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Lock "cinder-5e23de7f-3a55-4e87-b880-ba90f27caa9f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Acquiring lock "cinder-quobyte-5e23de7f-3a55-4e87-b880-ba90f27caa9f" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Lock "cinder-quobyte-5e23de7f-3a55-4e87-b880-ba90f27caa9f" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[95305510-bed8-4648-bf1d-e76905b4371b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:12 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f Nov 02 10:38:12 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:12 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f" returned: 0 in 0.546s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:12 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f Nov 02 10:38:12 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:12 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5e23de7f-3a55-4e87-b880-ba90f27caa9f" returned: 0 in 0.475s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Lock "cinder-quobyte-5e23de7f-3a55-4e87-b880-ba90f27caa9f" released by "delete_volume" :: held 1.099s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Created reservations ['66ad9b85-caab-4a98-a8e4-9534fcf9f1d7', '67aa13e7-cfde-4d84-87ec-177f2c60c745', '1951483d-589c-4a13-a9a0-bceb178710cf', '25cb5a21-e162-41c3-8c64-c86061f9842e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:13 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:13 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:13 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.343s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Deleted volume successfully. Nov 02 10:38:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6561402c-7e55-41fe-bcfe-30b0c89e0cdd tempest-VolumesTestJSON-358584712 None] Lock "cinder-5e23de7f-3a55-4e87-b880-ba90f27caa9f-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ac86e324-7448-4e60-b21c-c52a104a9869 tempest-GroupsV314Test-370404274 None] Group tempest-GroupsV314Test-Group-2094348620: creating Nov 02 10:38:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ac86e324-7448-4e60-b21c-c52a104a9869 tempest-GroupsV314Test-370404274 None] Group tempest-GroupsV314Test-Group-2094348620: created successfully Nov 02 10:38:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ac86e324-7448-4e60-b21c-c52a104a9869 tempest-GroupsV314Test-370404274 None] Create group completed successfully. Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Flow 'volume_create_manager' (b1201066-6c09-4f6c-b489-354ba3c7eb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0465357e-bd52-4850-8712-0dc233ebf7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0465357e-bd52-4850-8712-0dc233ebf7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-633276113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2833bc-bc1d-4681-a236-0f4cdb8c9232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667675df4edf47af9a418665d5d2dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:22Z,use_quota=True,user_id='558b39c232c24fb4b9560cccae8cf05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80235ad1-e1e8-456c-87e4-358eee40ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80235ad1-e1e8-456c-87e4-358eee40ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186c574a-23e3-45f3-a246-bdd851999970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186c574a-23e3-45f3-a246-bdd851999970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2833bc-bc1d-4681-a236-0f4cdb8c9232', 'volume_name': 'volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1969d6dc-5f19-444d-9bb5-796a6c2d0969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1969d6dc-5f19-444d-9bb5-796a6c2d0969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91ae9d6-5f27-4d4d-b6c7-5790adaec81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Volume 1b2833bc-bc1d-4681-a236-0f4cdb8c9232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232', 'volume_size': 1} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-633276113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2833bc-bc1d-4681-a236-0f4cdb8c9232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667675df4edf47af9a418665d5d2dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:22Z,use_quota=True,user_id='558b39c232c24fb4b9560cccae8cf05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Creating volume 1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:38:22 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:22 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 1073741824 Nov 02 10:38:22 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:22 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:22 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:22 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 1073741824" returned: 0 in 0.671s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Flow 'volume_create_manager' (c35b5dd7-c0b4-44f6-85b5-05ea96a22652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:22 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf326f-66c7-4bf9-8a62-ef9268af7ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.344s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 8 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf326f-66c7-4bf9-8a62-ef9268af7ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873037578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b092f728-cd91-4dc7-b031-6242e1a81e0a,host='devstack@QuobyteHD#QuobyteHD',id=f411aaad-40e6-4b49-83c4-51f6b46906b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8569846ca54efd976dac9862667fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:23Z,use_quota=True,user_id='ab345d34e63e45f09c145f4c7ffe4cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abb7cc4c-7c32-4043-810e-d6a4f8b92f0d),volume_type_id=abb7cc4c-7c32-4043-810e-d6a4f8b92f0d)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589754da-628c-42e6-b8ed-065cfdb3a209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589754da-628c-42e6-b8ed-065cfdb3a209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7957509-2787-4dba-b9d5-982e7b3a90c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7957509-2787-4dba-b9d5-982e7b3a90c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f411aaad-40e6-4b49-83c4-51f6b46906b1', 'volume_name': 'volume-f411aaad-40e6-4b49-83c4-51f6b46906b1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ee8e53-08ba-42d5-854c-f1f6f56af6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ee8e53-08ba-42d5-854c-f1f6f56af6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5236921e-a0f1-408d-82a5-1d129461e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Volume f411aaad-40e6-4b49-83c4-51f6b46906b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f411aaad-40e6-4b49-83c4-51f6b46906b1', 'volume_size': 1} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:23 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 Nov 02 10:38:23 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:23 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b092f728-cd91-4dc7-b031-6242e1a81e0a,created_at=2026-11-02T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873037578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b092f728-cd91-4dc7-b031-6242e1a81e0a,host='devstack@QuobyteHD#QuobyteHD',id=f411aaad-40e6-4b49-83c4-51f6b46906b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8569846ca54efd976dac9862667fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:23Z,use_quota=True,user_id='ab345d34e63e45f09c145f4c7ffe4cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abb7cc4c-7c32-4043-810e-d6a4f8b92f0d),volume_type_id=abb7cc4c-7c32-4043-810e-d6a4f8b92f0d)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Creating volume f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:38:23 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91ae9d6-5f27-4d4d-b6c7-5790adaec81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:23 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 1073741824 Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c757cc-0701-4660-8f9f-640d0255f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:23 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:23 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Volume volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 (1b2833bc-bc1d-4681-a236-0f4cdb8c9232): created successfully Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c757cc-0701-4660-8f9f-640d0255f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Flow 'volume_create_manager' (b1201066-6c09-4f6c-b489-354ba3c7eb9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-e1e08168-54af-4c86-a11a-220bf8b3f2f4 req-426aece8-742a-44f5-9bc5-265b21b88c13 tempest-VolumesSnapshotsTestJSON-517908624 None] Created volume successfully. Nov 02 10:38:24 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 1073741824" returned: 0 in 0.755s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:24 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 Nov 02 10:38:24 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:24 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1" returned: 0 in 0.676s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5236921e-a0f1-408d-82a5-1d129461e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f411aaad-40e6-4b49-83c4-51f6b46906b1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfacdbf5-35dc-4714-87d7-06470871c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Volume volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 (f411aaad-40e6-4b49-83c4-51f6b46906b1): created successfully Nov 02 10:38:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfacdbf5-35dc-4714-87d7-06470871c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Flow 'volume_create_manager' (c35b5dd7-c0b4-44f6-85b5-05ea96a22652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-18cd6676-07a8-48ab-8369-e8fe1b09a12b tempest-GroupsV314Test-370404274 None] Created volume successfully. Nov 02 10:38:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Creating offline snapshot 00eeff3c-2e76-4fb1-81c6-ba816604fe4a of volume 1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:38:25 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[33841452-5df2-44ac-8a60-950667b0381a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:25 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 Nov 02 10:38:25 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:26 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" returned: 0 in 0.793s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:26 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a 1G Nov 02 10:38:26 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:27 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=103,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=11 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:27 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a 1G" returned: 0 in 0.940s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:27 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a Nov 02 10:38:27 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:27 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a" returned: 0 in 0.470s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:27 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a is being set with open permissions: ugo+rw Nov 02 10:38:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:27 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a Nov 02 10:38:27 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:28 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a" returned: 0 in 0.369s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:28 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info Nov 02 10:38:28 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:28 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info" returned: 0 in 0.417s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:28 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info is being set with open permissions: ugo+rw Nov 02 10:38:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:28 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info Nov 02 10:38:28 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:29 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.info" returned: 0 in 0.453s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.647s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.018s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:29 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Cloning volume f411aaad-40e6-4b49-83c4-51f6b46906b1 to volume a6b7a01a-5f05-470f-ac76-b625f3c186d4 Nov 02 10:38:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Creating offline snapshot a01c8ab4-fdb2-4502-8c8f-00770b4d8135 of volume f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:38:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-421919fd-d52e-48ab-88c6-ef9fe5de46f5 req-3d6eb34b-a4b1-4d12-8851-467b654707dc tempest-VolumesSnapshotsTestJSON-517908624 None] Create snapshot completed successfully Nov 02 10:38:29 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[803aa48e-31b4-4166-b1f4-8bb60b0d2027]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:29 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 Nov 02 10:38:29 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:29 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1" returned: 0 in 0.594s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:30 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 1G Nov 02 10:38:30 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-330e8562-8b72-4f2f-ac2c-d876a6bd580c req-32026624-e8aa-4f72-997b-f0d5d8713d85 tempest-ServerActionsTestOtherA-1127498219 None] Terminate volume connection completed successfully. Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-330e8562-8b72-4f2f-ac2c-d876a6bd580c req-32026624-e8aa-4f72-997b-f0d5d8713d85 tempest-ServerActionsTestOtherA-1127498219 None] Deleting attachment 532bdd57-08c0-4bfc-b6a6-ba3ad7dba909. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:38:30 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 1G" returned: 0 in 0.612s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "cinder-00eeff3c-2e76-4fb1-81c6-ba816604fe4a-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:30 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 Nov 02 10:38:30 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-00eeff3c-2e76-4fb1-81c6-ba816604fe4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "cinder-quobyte-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-quobyte-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "cinder-quobyte-00eeff3c-2e76-4fb1-81c6-ba816604fe4a" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-quobyte-00eeff3c-2e76-4fb1-81c6-ba816604fe4a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Deleting offline snapshot 00eeff3c-2e76-4fb1-81c6-ba816604fe4a of volume 1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] snapshot_file for this snap is: volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfae57-c66f-4751-9608-d82801358442]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:30 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a Nov 02 10:38:30 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:31 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135" returned: 0 in 0.513s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:31 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:31 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 Nov 02 10:38:31 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:31 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a" returned: 0 in 0.646s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d8806-bc3f-4231-a3f4-f99094f595f9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:31 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135" returned: 0 in 0.465s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:31 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 Nov 02 10:38:31 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:31 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info Nov 02 10:38:31 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:32 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info" returned: 0 in 0.490s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:32 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:32 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info Nov 02 10:38:32 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:32 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" returned: 0 in 1.050s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:32 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a Nov 02 10:38:32 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:32 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.info" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Acquiring lock "cinder-quobyte-a6b7a01a-5f05-470f-ac76-b625f3c186d4" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-a6b7a01a-5f05-470f-ac76-b625f3c186d4" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] snapshot: a01c8ab4-fdb2-4502-8c8f-00770b4d8135, volume: a6b7a01a-5f05-470f-ac76-b625f3c186d4, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b286e-4a4a-4a99-9d26-5e41b23fb479]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:32 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 Nov 02 10:38:32 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:33 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a" returned: 0 in 0.574s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:33 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a Nov 02 10:38:33 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:33 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135" returned: 0 in 0.680s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f411aaad-40e6-4b49-83c4-51f6b46906b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e7497a-ab2e-4585-970d-2db32376ed16]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:33 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232.00eeff3c-2e76-4fb1-81c6-ba816604fe4a" returned: 0 in 0.470s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:33 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 Nov 02 10:38:33 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-quobyte-00eeff3c-2e76-4fb1-81c6-ba816604fe4a" released by "_delete_snapshot" :: held 2.913s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-quobyte-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" released by "delete_snapshot" :: held 2.950s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:33 devstack cinder-volume[86926]: WARNING cinder.quota [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.quota [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Created reservations ['9fbcb73d-ccff-4030-8476-b918dcb1ef43', 'c01487ea-230d-4ea6-9d28-02b2874ae4d9', 'fbe00ab2-675c-4262-a3be-9ed13443ea82', 'e0eca9bc-48a2-4b8b-990f-1807a632e8cf'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Delete snapshot completed successfully. Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-a28f74b2-ec90-4f58-b0e6-d6b2b509251f req-43e089cf-bc2d-4cc5-be27-310cbd53521c tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-00eeff3c-2e76-4fb1-81c6-ba816604fe4a-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:33 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1" returned: 0 in 0.539s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:38:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:34 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 Nov 02 10:38:34 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "cinder-1b2833bc-bc1d-4681-a236-0f4cdb8c9232-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-1b2833bc-bc1d-4681-a236-0f4cdb8c9232-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "cinder-quobyte-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-quobyte-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de5c79-eeeb-458b-9143-fae35ece3c07]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:34 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 Nov 02 10:38:34 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:35 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" returned: 0 in 0.973s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:35 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232 Nov 02 10:38:35 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:36 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" returned: 0 in 0.852s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-quobyte-1b2833bc-bc1d-4681-a236-0f4cdb8c9232" released by "delete_volume" :: held 1.970s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG cinder.quota [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Created reservations ['a4a79de0-9dd1-4eef-b865-2cef4903c26e', '64a4db47-c988-4198-b0ef-fcd310a8906f', 'b08e57b8-06f8-41f2-ac80-a9886ef7b658', 'f2eef83b-4a56-488b-825f-f63df28ee750'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:37 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:37 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:37 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.941s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:37 devstack cinder-volume[86926]: DEBUG cinder.manager [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Deleted volume successfully. Nov 02 10:38:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1f78abc9-fe41-4ff2-b5e0-013f8f54daf3 req-c5255072-242f-4d2f-85ff-7285db67ba7f tempest-VolumesSnapshotsTestJSON-517908624 None] Lock "cinder-1b2833bc-bc1d-4681-a236-0f4cdb8c9232-delete_volume" released by "delete_volume" :: held 3.696s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Flow 'volume_create_manager' (63d4a721-cd43-4e70-beb9-9c7cefdfe307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26356f2-5dd9-4817-9062-87c872462e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26356f2-5dd9-4817-9062-87c872462e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-491109300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c91da8f-f0c0-441a-a50c-601a4ed25040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce8df8898c43788735d25d2958e699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:42Z,use_quota=True,user_id='ebaa777cdd7540edaee92394043f3e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e865b80b-be9d-4ad7-825f-4e1adc776188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e865b80b-be9d-4ad7-825f-4e1adc776188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b421149f-32e2-440d-b371-d9602b3f51e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:42 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:38:43 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4" returned: 0 in 9.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1, size 1024.00 MB, duration 9.39 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:38:43 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Converted 1024.00 MB image at 109.10 MB/s Nov 02 10:38:43 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:43 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 Nov 02 10:38:43 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b421149f-32e2-440d-b371-d9602b3f51e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c91da8f-f0c0-441a-a50c-601a4ed25040', 'volume_name': 'volume-5c91da8f-f0c0-441a-a50c-601a4ed25040', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1064a93-66e3-4c67-9dd7-2b8b99f8acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1064a93-66e3-4c67-9dd7-2b8b99f8acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e125153-8af6-48e1-8997-15bd6a752ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Volume 5c91da8f-f0c0-441a-a50c-601a4ed25040: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c91da8f-f0c0-441a-a50c-601a4ed25040', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Trying to clone 5c91da8f-f0c0-441a-a50c-601a4ed25040 from image 6256c21e-7619-488e-bde7-257c3f79e20b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:38:43 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4" returned: 0 in 0.283s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-a6b7a01a-5f05-470f-ac76-b625f3c186d4" released by "_copy_volume_from_snapshot" :: held 10.999s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Acquiring lock "cinder-quobyte-a01c8ab4-fdb2-4502-8c8f-00770b4d8135" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-a01c8ab4-fdb2-4502-8c8f-00770b4d8135" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Deleting offline snapshot a01c8ab4-fdb2-4502-8c8f-00770b4d8135 of volume f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] snapshot_file for this snap is: volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[42da1490-8561-4321-8aae-0e12f332f06e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:38:43 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:38:43 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 Nov 02 10:38:43 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c37a68-87fa-4942-90b2-11471282bf0c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:44 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD Nov 02 10:38:44 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:44 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135" returned: 0 in 0.445s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f411aaad-40e6-4b49-83c4-51f6b46906b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[106dd631-7951-4923-b9d5-eae65a10c1ea]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:44 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b is fetched for user ebaa777cdd7540edaee92394043f3e1c. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:38:44 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 Nov 02 10:38:44 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b1d58-c142-41b8-bd1f-0bdf2bdc1087]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:44 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD Nov 02 10:38:44 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:44 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:44 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1" returned: 0 in 0.547s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:44 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 Nov 02 10:38:44 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:45 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135" returned: 0 in 0.337s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:45 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135 Nov 02 10:38:45 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:45 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1.a01c8ab4-fdb2-4502-8c8f-00770b4d8135" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-a01c8ab4-fdb2-4502-8c8f-00770b4d8135" released by "_delete_snapshot" :: held 1.735s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.249s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-491109300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c91da8f-f0c0-441a-a50c-601a4ed25040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce8df8898c43788735d25d2958e699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:42Z,use_quota=True,user_id='ebaa777cdd7540edaee92394043f3e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Creating volume 5c91da8f-f0c0-441a-a50c-601a4ed25040 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:38:45 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:38:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:45 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 1073741824 Nov 02 10:38:45 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-45674afa-bca3-4d60-97b6-d3af8ae64512 tempest-GroupsV314Test-370404274 None] Create group from source-group-b092f728-cd91-4dc7-b031-6242e1a81e0a completed successfully. Nov 02 10:38:46 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 1073741824" returned: 0 in 0.588s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:46 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 Nov 02 10:38:46 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:46 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040" returned: 0 in 0.300s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Attempting download of 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume 5c91da8f-f0c0-441a-a50c-601a4ed25040. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b8074-38c2-4c70-98ae-01f305f25456]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:46 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc Nov 02 10:38:46 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:46 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:47 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc Nov 02 10:38:47 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Acquiring lock "cinder-quobyte-a6b7a01a-5f05-470f-ac76-b625f3c186d4" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-a6b7a01a-5f05-470f-ac76-b625f3c186d4" acquired by "delete_volume" :: waited 0.053s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:47 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc" returned: 1 in 0.361s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_0nh9ahzc' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f79763-b2e6-4f16-aacc-348999b40cac]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eee76d-5cf3-4551-bc9c-eb1dbb8960e7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:47 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 Nov 02 10:38:47 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:47 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD Nov 02 10:38:47 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:47 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:47 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] 6256c21e-7619-488e-bde7-257c3f79e20b was qcow2, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4" returned: 0 in 0.502s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:47 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 Nov 02 10:38:47 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:47 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4 Nov 02 10:38:47 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:48 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6b7a01a-5f05-470f-ac76-b625f3c186d4" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-a6b7a01a-5f05-470f-ac76-b625f3c186d4" released by "delete_volume" :: held 0.863s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Created reservations ['0ffb2b01-16c4-4c00-b847-39b36ccb726d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:48 devstack cinder-volume[86926]: WARNING cinder.quota [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-97541923 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-97541923, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:38:48 devstack cinder-volume[86926]: WARNING cinder.quota [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-97541923 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-97541923, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Created reservations ['29330fa4-9713-4b7b-afab-c753f2b8b2e9', 'a2208111-f034-415c-afb8-63d6231969c7', '36ee27bb-cddf-4708-b77e-b1080f044f33', '463160ce-6229-4e8a-816c-1753579a6977'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:48 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:48 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:48 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ef7d198a-01b4-4e52-bbe1-d9e0a4cfdfab tempest-GroupsV314Test-370404274 None] Delete group completed successfully. Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Acquiring lock "cinder-quobyte-f411aaad-40e6-4b49-83c4-51f6b46906b1" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-f411aaad-40e6-4b49-83c4-51f6b46906b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0e166c-0478-44f6-94fb-5afc26e2e8ea]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:38:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:49 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 Nov 02 10:38:49 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:49 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1" returned: 0 in 0.479s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:49 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1 Nov 02 10:38:49 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:49 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f411aaad-40e6-4b49-83c4-51f6b46906b1" returned: 0 in 0.299s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Lock "cinder-quobyte-f411aaad-40e6-4b49-83c4-51f6b46906b1" released by "delete_volume" :: held 0.877s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Created reservations ['9b5ae61c-cb70-448b-a8b4-de5ca20e8651'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Created reservations ['1a20e026-ea26-44e1-b0b0-330794f20548', '83884f31-c825-4285-9075-426d0c5c5fa9', 'a8d27cfa-fd19-499a-86c7-34e3880ede2f', '3863694d-beb6-4d25-90b1-d2a5180c326b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:50 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:38:50 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c5e5d45-10c9-4f8d-8736-6a0929bf55c9 tempest-BackendsCapabilitiesAdminTestsJSON-1118098007 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8625526428223, 'free_capacity_gb': 1773.8625526428223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86926) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c5723b2d-453f-4272-b6c8-cbc8bfab2507 tempest-BackendsCapabilitiesAdminTestsJSON-1118098007 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8625526428223, 'free_capacity_gb': 1773.8625526428223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86926) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:38:50 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040" returned: 0 in 2.507s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_pcup6cwedevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:38:50 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Converted 112.00 MB image at 44.66 MB/s Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:50 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 1G Nov 02 10:38:50 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:50 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.458s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-98dab6b0-9b6a-42ec-ab26-a16958f72569 tempest-GroupsV314Test-370404274 None] Delete group completed successfully. Nov 02 10:38:50 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 1G" returned: 0 in 0.516s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Downloaded image 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume 5c91da8f-f0c0-441a-a50c-601a4ed25040 successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b for user ebaa777cdd7540edaee92394043f3e1c is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Marking volume 5c91da8f-f0c0-441a-a50c-601a4ed25040 as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Copying metadata from image 6256c21e-7619-488e-bde7-257c3f79e20b to 5c91da8f-f0c0-441a-a50c-601a4ed25040. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Creating volume glance metadata for volume 5c91da8f-f0c0-441a-a50c-601a4ed25040 backed by image 6256c21e-7619-488e-bde7-257c3f79e20b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Flow 'volume_create_manager' (ac8576a7-c50d-4d89-87d8-e5d10b1e0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c54fcab-7ea4-49ac-93ce-aa847c3cc8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c54fcab-7ea4-49ac-93ce-aa847c3cc8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1873713707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025774fb-a5f3-4bfc-aac6-9e7772adae09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc57107de2a44baa0c9c272e65be283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:51Z,use_quota=True,user_id='b1f10325806d431b934073d190ddee91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c84efd-aca1-465a-83f7-358a1e578f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c84efd-aca1-465a-83f7-358a1e578f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa795a-0a8c-453e-9b00-e8661c110a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa795a-0a8c-453e-9b00-e8661c110a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025774fb-a5f3-4bfc-aac6-9e7772adae09', 'volume_name': 'volume-025774fb-a5f3-4bfc-aac6-9e7772adae09', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c05b048-fca9-40f4-a6d8-633cb3a8f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c05b048-fca9-40f4-a6d8-633cb3a8f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2383bba2-68c2-4da4-89f4-d7004f6e44f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Volume 025774fb-a5f3-4bfc-aac6-9e7772adae09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025774fb-a5f3-4bfc-aac6-9e7772adae09', 'volume_size': 1} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1873713707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025774fb-a5f3-4bfc-aac6-9e7772adae09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc57107de2a44baa0c9c272e65be283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:38:51Z,use_quota=True,user_id='b1f10325806d431b934073d190ddee91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Creating volume 025774fb-a5f3-4bfc-aac6-9e7772adae09 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:38:51 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:51 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 1073741824 Nov 02 10:38:51 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e125153-8af6-48e1-8997-15bd6a752ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c91da8f-f0c0-441a-a50c-601a4ed25040', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b691105a-3a69-4124-a89f-358da910c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Volume volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 (5c91da8f-f0c0-441a-a50c-601a4ed25040): created successfully Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b691105a-3a69-4124-a89f-358da910c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Flow 'volume_create_manager' (63d4a721-cd43-4e70-beb9-9c7cefdfe307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-282dda49-9171-4476-993b-fa59177bc053 tempest-ServerActionsTestOtherA-1127498219 None] Created volume successfully. Nov 02 10:38:51 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 1073741824" returned: 0 in 0.532s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:51 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 Nov 02 10:38:51 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:51 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2383bba2-68c2-4da4-89f4-d7004f6e44f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025774fb-a5f3-4bfc-aac6-9e7772adae09', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ea0b00-0c15-408b-afb0-201b5dd4c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:38:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Volume volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 (025774fb-a5f3-4bfc-aac6-9e7772adae09): created successfully Nov 02 10:38:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ea0b00-0c15-408b-afb0-201b5dd4c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:38:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Flow 'volume_create_manager' (ac8576a7-c50d-4d89-87d8-e5d10b1e0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:38:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-64a1be9c-23ac-44da-b9b9-a6f1617644ff tempest-AttachVolumeNegativeTest-315741834 None] Created volume successfully. Nov 02 10:38:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c07db93d-d9d5-4ad4-9995-2f07ab69e351 req-61782bea-0866-40f4-a385-add28b19993f tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c07db93d-d9d5-4ad4-9995-2f07ab69e351 req-61782bea-0866-40f4-a385-add28b19993f tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c07db93d-d9d5-4ad4-9995-2f07ab69e351 req-61782bea-0866-40f4-a385-add28b19993f tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-c07db93d-d9d5-4ad4-9995-2f07ab69e351 req-61782bea-0866-40f4-a385-add28b19993f tempest-AttachVolumeNegativeTest-315741834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-025774fb-a5f3-4bfc-aac6-9e7772adae09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '286fc5e7-cc03-470b-9df4-45f4719f190b', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:38:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-c07db93d-d9d5-4ad4-9995-2f07ab69e351 req-61782bea-0866-40f4-a385-add28b19993f tempest-AttachVolumeNegativeTest-315741834 None] attachment_update completed successfully. Nov 02 10:38:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-98f7bae7-be49-4a9c-ad33-ece216e0a2a3 req-dee0cb86-1d79-4923-9d5a-3ccdcc4a6a45 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-98f7bae7-be49-4a9c-ad33-ece216e0a2a3 req-dee0cb86-1d79-4923-9d5a-3ccdcc4a6a45 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-98f7bae7-be49-4a9c-ad33-ece216e0a2a3 req-dee0cb86-1d79-4923-9d5a-3ccdcc4a6a45 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-98f7bae7-be49-4a9c-ad33-ece216e0a2a3 req-dee0cb86-1d79-4923-9d5a-3ccdcc4a6a45 tempest-ServerActionsTestOtherA-1127498219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-5c91da8f-f0c0-441a-a50c-601a4ed25040', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d5a61a4-c7d1-45e5-8a75-0db5468a4681', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:38:56 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-98f7bae7-be49-4a9c-ad33-ece216e0a2a3 req-dee0cb86-1d79-4923-9d5a-3ccdcc4a6a45 tempest-ServerActionsTestOtherA-1127498219 None] attachment_update completed successfully. Nov 02 10:38:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2d410507-c53b-4731-9fef-fc391525abf0 tempest-GroupSnapshotsTest-1873383423 None] Group tempest-GroupSnapshotsTest-Group-249223637: creating Nov 02 10:38:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2d410507-c53b-4731-9fef-fc391525abf0 tempest-GroupSnapshotsTest-1873383423 None] Group tempest-GroupSnapshotsTest-Group-249223637: created successfully Nov 02 10:38:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2d410507-c53b-4731-9fef-fc391525abf0 tempest-GroupSnapshotsTest-1873383423 None] Create group completed successfully. Nov 02 10:38:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-28c74c11-976b-43ba-a12d-07094c74ce3d tempest-GroupsV320Test-1634356994 None] Group tempest-GroupsV320Test-Group-731526188: creating Nov 02 10:38:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-28c74c11-976b-43ba-a12d-07094c74ce3d tempest-GroupsV320Test-1634356994 None] Group tempest-GroupsV320Test-Group-731526188: created successfully Nov 02 10:38:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-28c74c11-976b-43ba-a12d-07094c74ce3d tempest-GroupsV320Test-1634356994 None] Create group completed successfully. Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Created reservations ['df9f2cb8-9446-49c8-8db2-dd93fbb285eb'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:01 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:39:01 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (03ea96f6-a311-4fa5-8899-3931b9d7d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182029e6-1532-44f7-b486-4cdb8c6778e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182029e6-1532-44f7-b486-4cdb8c6778e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537704683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6ba6394-a586-4807-ab4b-9c5ae05a0a12,host='devstack@QuobyteHD#QuobyteHD',id=25f94845-54eb-4f46-85ab-eadb6a8b17b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:01Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(464dae00-8a51-4881-bbcc-cb9ca71e0087),volume_type_id=464dae00-8a51-4881-bbcc-cb9ca71e0087)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4047de9-37d7-414e-913b-0306da352d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4047de9-37d7-414e-913b-0306da352d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870b0408-0906-4d2d-9d57-50c88c4375d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870b0408-0906-4d2d-9d57-50c88c4375d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f94845-54eb-4f46-85ab-eadb6a8b17b3', 'volume_name': 'volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f953c4-1909-4855-8a89-ec11d03f3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f953c4-1909-4855-8a89-ec11d03f3e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd920002-2997-4d4e-9543-6a6623850fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Volume 25f94845-54eb-4f46-85ab-eadb6a8b17b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3', 'volume_size': 1} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6ba6394-a586-4807-ab4b-9c5ae05a0a12,created_at=2026-11-02T09:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537704683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6ba6394-a586-4807-ab4b-9c5ae05a0a12,host='devstack@QuobyteHD#QuobyteHD',id=25f94845-54eb-4f46-85ab-eadb6a8b17b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:01Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(464dae00-8a51-4881-bbcc-cb9ca71e0087),volume_type_id=464dae00-8a51-4881-bbcc-cb9ca71e0087)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Creating volume 25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:39:01 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:01 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 1073741824 Nov 02 10:39:01 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:01 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.333s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:01 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:39:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7a669ccc-dea1-4e70-b4d4-d8e4904c3d67 tempest-GroupsV320Test-1634356994 None] Delete group completed successfully. Nov 02 10:39:02 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 1073741824" returned: 0 in 0.904s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:02 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 Nov 02 10:39:02 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:02 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3" returned: 0 in 0.474s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd920002-2997-4d4e-9543-6a6623850fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554fbcf3-b39c-4d77-a91a-581e5ddc0899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Volume volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 (25f94845-54eb-4f46-85ab-eadb6a8b17b3): created successfully Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554fbcf3-b39c-4d77-a91a-581e5ddc0899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (03ea96f6-a311-4fa5-8899-3931b9d7d171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-598fe86f-f559-40ef-91f7-1705f9bb8211 tempest-GroupSnapshotsTest-1873383423 None] Created volume successfully. Nov 02 10:39:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] GroupSnapshot 09241ddb-9f38-4bfe-99df-a4a077e9f908: creating. Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:INSERT=30,cinder:UPDATE=105,cinder:SELECT=100,cinder:DELETE=5 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Group snapshot 09241ddb-9f38-4bfe-99df-a4a077e9f908: creating. {{(pid=86926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Creating offline snapshot b837ee68-4237-48ce-bb0f-8621fe64518d of volume 25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad546bfa-80c8-48e3-bd19-c6cacbe1ebf0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:04 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 Nov 02 10:39:04 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:05 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3" returned: 0 in 0.627s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:05 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d 1G Nov 02 10:39:05 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:06 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d 1G" returned: 0 in 0.797s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:06 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d Nov 02 10:39:06 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:06 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d" returned: 0 in 0.519s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:06 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:39:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:06 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d Nov 02 10:39:06 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:07 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d" returned: 0 in 0.602s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info Nov 02 10:39:07 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:07 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info" returned: 0 in 0.635s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:07 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:39:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info Nov 02 10:39:07 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:08 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.info" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.752s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b7e3dc3e-640f-46ee-8d91-b5e65ed57765 tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 09241ddb-9f38-4bfe-99df-a4a077e9f908: created successfully Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-b837ee68-4237-48ce-bb0f-8621fe64518d-a1841575-7d4b-44df-88b2-1ec16cdd7634" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-b837ee68-4237-48ce-bb0f-8621fe64518d-a1841575-7d4b-44df-88b2-1ec16cdd7634" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Creating volume a1841575-7d4b-44df-88b2-1ec16cdd7634 from snapshot b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-a1841575-7d4b-44df-88b2-1ec16cdd7634" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-a1841575-7d4b-44df-88b2-1ec16cdd7634" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] snapshot: b837ee68-4237-48ce-bb0f-8621fe64518d, volume: a1841575-7d4b-44df-88b2-1ec16cdd7634, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee8250-800e-4c45-9bd9-66384bf0a434]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:12 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d Nov 02 10:39:12 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:12 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d" returned: 0 in 1.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa6d98e-bfa0-4c16-9a83-8632b02ef518]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:13 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 Nov 02 10:39:13 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:14 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3" returned: 0 in 1.126s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:39:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:39:14 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:39:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:14 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 Nov 02 10:39:14 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Flow 'volume_create_manager' (33769058-bfdb-458a-b4ea-0d56faa9773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5c59fd-e8fd-4fa2-a72d-e9453f7c250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5c59fd-e8fd-4fa2-a72d-e9453f7c250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1214589101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee812c6-2673-44b2-90c4-8a06e6fcedfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bd71e489140f2bdbc7ee85db973ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:19Z,use_quota=True,user_id='98ebc41164b947e18d2df46f6cf49797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b13ed8c-844f-40d3-b603-b2a6d7a3792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b13ed8c-844f-40d3-b603-b2a6d7a3792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba84a97f-a2eb-40cf-97ad-2b4f6c1e3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba84a97f-a2eb-40cf-97ad-2b4f6c1e3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee812c6-2673-44b2-90c4-8a06e6fcedfe', 'volume_name': 'volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c14d192-4d0d-436d-8a43-871fa302a1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c14d192-4d0d-436d-8a43-871fa302a1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0475d276-6b02-4bec-913e-917a751029d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:19 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe', 'volume_size': 1} Nov 02 10:39:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:22 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:39:22 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:23 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.654s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:39:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:39:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:39:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:39:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-444f51be-080a-4f4b-b2f0-c9fbc247901c tempest-ServerActionsTestOtherA-1127498219 None] Terminate volume connection completed successfully. Nov 02 10:39:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-444f51be-080a-4f4b-b2f0-c9fbc247901c tempest-ServerActionsTestOtherA-1127498219 None] Deleting attachment 4d5a61a4-c7d1-45e5-8a75-0db5468a4681. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:39:27 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634" returned: 0 in 13.907s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:27 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3, size 1024.00 MB, duration 13.91 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:39:27 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Converted 1024.00 MB image at 73.62 MB/s Nov 02 10:39:27 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:39:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:28 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 Nov 02 10:39:28 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:28 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634" returned: 0 in 0.273s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-a1841575-7d4b-44df-88b2-1ec16cdd7634" released by "_copy_volume_from_snapshot" :: held 16.997s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=79,cinder:UPDATE=59,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-b837ee68-4237-48ce-bb0f-8621fe64518d-a1841575-7d4b-44df-88b2-1ec16cdd7634" released by "_create_volume_from_snapshot" :: held 17.100s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.131s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.922s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1214589101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee812c6-2673-44b2-90c4-8a06e6fcedfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bd71e489140f2bdbc7ee85db973ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:19Z,use_quota=True,user_id='98ebc41164b947e18d2df46f6cf49797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Creating volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:39:28 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:28 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe 1073741824 Nov 02 10:39:28 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8ac62695-ebcd-4fe9-a679-882a23d38b1d tempest-GroupSnapshotsTest-1873383423 None] Create group from source-snapshot-09241ddb-9f38-4bfe-99df-a4a077e9f908 completed successfully. Nov 02 10:39:28 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe 1073741824" returned: 0 in 0.550s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-f77b009f-af7f-46d2-908d-d5f66190a00b tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:28 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe Nov 02 10:39:28 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:29 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" returned: 0 in 0.284s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-f77b009f-af7f-46d2-908d-d5f66190a00b tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.262s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0475d276-6b02-4bec-913e-917a751029d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c41905e-c57e-4ea8-8512-86e114a2715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-f77b009f-af7f-46d2-908d-d5f66190a00b tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:29 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Volume volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe (4ee812c6-2673-44b2-90c4-8a06e6fcedfe): created successfully Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c41905e-c57e-4ea8-8512-86e114a2715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Flow 'volume_create_manager' (33769058-bfdb-458a-b4ea-0d56faa9773c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-db32ae5e-a042-42df-8229-45f4f689bb0b tempest-SnapshotsActionsTest-805761989 None] Created volume successfully. Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-f77b009f-af7f-46d2-908d-d5f66190a00b tempest-ServerActionsTestOtherA-1127498219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-5c91da8f-f0c0-441a-a50c-601a4ed25040', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a8a9c7f-2893-496f-b9f9-451685275085', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:39:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-7fa9194b-0169-4744-b849-18abbb9e3170 req-f77b009f-af7f-46d2-908d-d5f66190a00b tempest-ServerActionsTestOtherA-1127498219 None] attachment_update completed successfully. Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-a1841575-7d4b-44df-88b2-1ec16cdd7634" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-a1841575-7d4b-44df-88b2-1ec16cdd7634" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e898d9-b758-41f6-9ed7-d8a8708371b8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:29 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 Nov 02 10:39:29 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Creating offline snapshot 25a4fd3a-1826-4c8f-b0aa-16039b2218b4 of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3f052-1299-46d1-adff-bc68ad895fd9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:30 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634" returned: 0 in 0.702s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:30 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634 Nov 02 10:39:30 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:30 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe Nov 02 10:39:30 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:30 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a1841575-7d4b-44df-88b2-1ec16cdd7634" returned: 0 in 0.507s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-a1841575-7d4b-44df-88b2-1ec16cdd7634" released by "delete_volume" :: held 1.287s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['a6671bc7-faee-416f-80a5-e2dd1a6ef905'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:30 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:30 devstack cinder-volume[86926]: WARNING cinder.quota [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1087908861 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1087908861, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:39:30 devstack cinder-volume[86926]: WARNING cinder.quota [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1087908861 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1087908861, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" returned: 0 in 0.828s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['1655493c-2407-4879-88d2-285994e6fa63', '728e87a5-985c-4a46-96db-94c942b70603', '18004d5a-f2f3-4133-87da-cd28f596558b', 'f8653654-2160-4607-b65a-9911103c15f4'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:31 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 1G Nov 02 10:39:31 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:31 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:39:31 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:31 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.322s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:39:31 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-491bc586-4994-46d9-81f1-2710cb8e86af tempest-GroupSnapshotsTest-1873383423 None] Delete group completed successfully. Nov 02 10:39:31 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 1G" returned: 0 in 0.538s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:31 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:31 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:31 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.368s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:31 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 is being set with open permissions: ugo+rw Nov 02 10:39:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:31 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:31 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 09241ddb-9f38-4bfe-99df-a4a077e9f908: deleting Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 09241ddb-9f38-4bfe-99df-a4a077e9f908: deleting {{(pid=86926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-25f94845-54eb-4f46-85ab-eadb6a8b17b3" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-25f94845-54eb-4f46-85ab-eadb6a8b17b3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-b837ee68-4237-48ce-bb0f-8621fe64518d" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:32 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-b837ee68-4237-48ce-bb0f-8621fe64518d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Deleting offline snapshot b837ee68-4237-48ce-bb0f-8621fe64518d of volume 25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] snapshot_file for this snap is: volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.415s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa1fcce-1364-4876-b71c-3e01b4152b60]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:32 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info Nov 02 10:39:32 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:32 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d Nov 02 10:39:32 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:32 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info" returned: 0 in 0.336s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:32 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info is being set with open permissions: ugo+rw Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:32 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info Nov 02 10:39:32 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:32 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d" returned: 0 in 0.466s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a93833-39c4-4daf-8816-5cb1ad96479b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:32 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 Nov 02 10:39:32 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:33 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.info" returned: 0 in 0.346s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bbd78e09-73ff-4d6a-b92d-a650c9554ede tempest-SnapshotsActionsTest-805761989 None] Create snapshot completed successfully Nov 02 10:39:33 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3" returned: 0 in 0.607s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:33 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d Nov 02 10:39:33 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:33 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d" returned: 0 in 0.509s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:33 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d Nov 02 10:39:34 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:34 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3.b837ee68-4237-48ce-bb0f-8621fe64518d" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-b837ee68-4237-48ce-bb0f-8621fe64518d" released by "_delete_snapshot" :: held 2.091s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-25f94845-54eb-4f46-85ab-eadb6a8b17b3" released by "delete_snapshot" :: held 2.136s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:34 devstack cinder-volume[86926]: WARNING cinder.quota [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1087908861 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1087908861, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:39:34 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['4caf783c-806a-48e2-92cd-e56b7d1d64bd', '1b386e41-6306-473e-9cb3-10390c7a8396', 'c48fe228-4a06-4ff8-9f42-6e54f1f02044', 'ab0bb422-7a6b-4874-a6d0-f55452a97d64'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-22e4d381-206a-4fc6-bc18-cffc9f69a52a tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 09241ddb-9f38-4bfe-99df-a4a077e9f908: deleted successfully Nov 02 10:39:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Creating offline snapshot 898e4eb2-4df5-4783-b1c2-f23f84c52b04 of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[955593ff-66f8-44d4-ba09-073a601bab18]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:35 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:35 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:36 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.676s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:36 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 1G Nov 02 10:39:36 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-25f94845-54eb-4f46-85ab-eadb6a8b17b3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-25f94845-54eb-4f46-85ab-eadb6a8b17b3" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abda0d-1899-4c66-93b8-631eae31e930]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:36 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 Nov 02 10:39:36 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:37 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 1G" returned: 0 in 0.887s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:37 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 Nov 02 10:39:37 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:37 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3" returned: 0 in 0.683s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:37 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3 Nov 02 10:39:37 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:37 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04" returned: 0 in 0.587s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:37 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 is being set with open permissions: ugo+rw Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:37 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25f94845-54eb-4f46-85ab-eadb6a8b17b3" returned: 0 in 0.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:37 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 Nov 02 10:39:37 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-25f94845-54eb-4f46-85ab-eadb6a8b17b3" released by "delete_volume" :: held 1.296s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['e47b68ca-81fb-40ec-bd4f-e99b684c692f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:37 devstack cinder-volume[86926]: WARNING cinder.db.api [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1087908861'] Nov 02 10:39:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['046042c2-0bfb-42f3-81a9-a81125049f60', '82266784-6b0c-45a2-a15b-cf6ce0ae5390', 'c1dd126d-baa5-4451-bf11-1ca9da8da6a7', 'c43d5dae-5fb3-49b3-998f-3dd75ec876ef'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:38 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5b039aba-7597-4436-bf1e-8c58f940e7b7 tempest-SnapshotsActionsTest-805761989 None] Create snapshot completed successfully Nov 02 10:39:38 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:39:38 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:38 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.297s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:39:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-36fb5b26-6d02-41ce-b945-39528d008360 tempest-GroupSnapshotsTest-1873383423 None] Delete group completed successfully. Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-898e4eb2-4df5-4783-b1c2-f23f84c52b04-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-898e4eb2-4df5-4783-b1c2-f23f84c52b04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-898e4eb2-4df5-4783-b1c2-f23f84c52b04" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-898e4eb2-4df5-4783-b1c2-f23f84c52b04" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Deleting offline snapshot 898e4eb2-4df5-4783-b1c2-f23f84c52b04 of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] snapshot_file for this snap is: volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d50e5-d864-4e33-b9d9-a1f87552c4a0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:38 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 Nov 02 10:39:38 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:39 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04" returned: 0 in 0.379s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[26481be0-b551-4941-93f7-43822b9dfd12]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:39 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:39 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:39 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c8d20ee-7485-4fe6-9817-e6a2191bc843 tempest-GroupSnapshotsTest-1873383423 None] Group tempest-GroupSnapshotsTest-Group-1796859689: creating Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.456s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:39 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 Nov 02 10:39:39 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c8d20ee-7485-4fe6-9817-e6a2191bc843 tempest-GroupSnapshotsTest-1873383423 None] Group tempest-GroupSnapshotsTest-Group-1796859689: created successfully Nov 02 10:39:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c8d20ee-7485-4fe6-9817-e6a2191bc843 tempest-GroupSnapshotsTest-1873383423 None] Create group completed successfully. Nov 02 10:39:40 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04" returned: 0 in 0.412s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:40 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04 Nov 02 10:39:40 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:40 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.898e4eb2-4df5-4783-b1c2-f23f84c52b04" returned: 0 in 0.276s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-898e4eb2-4df5-4783-b1c2-f23f84c52b04" released by "_delete_snapshot" :: held 1.641s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" released by "delete_snapshot" :: held 1.663s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Created reservations ['8cacaefb-8a1c-4a71-bcfa-de125e6fb20d', '3076aeab-994e-4bdd-b6f0-d8e389bb9927', '6c452212-2ab8-4ce3-8559-a654f6b5e58b', 'a08dd634-48da-44e3-b419-1826820afa60'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:40 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Delete snapshot completed successfully. Nov 02 10:39:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ebe20413-4ca5-4c93-8664-b39c86b71e0e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-898e4eb2-4df5-4783-b1c2-f23f84c52b04-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (cc5be1d3-a26e-4dbd-b024-bf38c81b2067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8616ba4b-a8ef-495d-be58-43dfb8aff05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Creating offline snapshot c199f026-a9e1-4e6d-97f0-d72a1187f35b of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8616ba4b-a8ef-495d-be58-43dfb8aff05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323287779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67455448-e231-423c-a4bd-c3f498c0b018,host='devstack@QuobyteHD#QuobyteHD',id=e938b99c-8977-4377-8f01-6e9e2608326f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:41Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c4d2f55-33e1-4880-8885-ba224dc58a80),volume_type_id=4c4d2f55-33e1-4880-8885-ba224dc58a80)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee96eba0-ce81-4113-b8cc-e39929b380a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee96eba0-ce81-4113-b8cc-e39929b380a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384bbc7f-8712-47dd-9cbe-ff230022a9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384bbc7f-8712-47dd-9cbe-ff230022a9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e938b99c-8977-4377-8f01-6e9e2608326f', 'volume_name': 'volume-e938b99c-8977-4377-8f01-6e9e2608326f', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a68b8a1-992d-45f6-a6f0-48a10e59efc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a68b8a1-992d-45f6-a6f0-48a10e59efc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c652585-2e78-4724-a732-90b11408291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Volume e938b99c-8977-4377-8f01-6e9e2608326f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e938b99c-8977-4377-8f01-6e9e2608326f', 'volume_size': 1} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f51ba-0195-4db8-ae68-13b69bb6d031]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:41 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:41 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:41 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.361s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:41 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b 1G Nov 02 10:39:41 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:42 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b 1G" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:42 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b Nov 02 10:39:42 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:42 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b" returned: 0 in 0.375s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:42 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b is being set with open permissions: ugo+rw Nov 02 10:39:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:42 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b Nov 02 10:39:42 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:43 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b" returned: 0 in 0.317s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.736s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67455448-e231-423c-a4bd-c3f498c0b018,created_at=2026-11-02T09:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323287779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67455448-e231-423c-a4bd-c3f498c0b018,host='devstack@QuobyteHD#QuobyteHD',id=e938b99c-8977-4377-8f01-6e9e2608326f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:41Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c4d2f55-33e1-4880-8885-ba224dc58a80),volume_type_id=4c4d2f55-33e1-4880-8885-ba224dc58a80)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Creating volume e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:39:43 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:43 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f 1073741824 Nov 02 10:39:43 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:43 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-459726c6-e0fc-43a2-92af-44160d605e83 tempest-SnapshotsActionsTest-805761989 None] Create snapshot completed successfully Nov 02 10:39:43 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f 1073741824" returned: 0 in 0.738s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:44 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f Nov 02 10:39:44 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:44 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f" returned: 0 in 0.392s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c652585-2e78-4724-a732-90b11408291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e938b99c-8977-4377-8f01-6e9e2608326f', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfbab6f-7caf-45b7-99c6-f65ce5d91062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Volume volume-e938b99c-8977-4377-8f01-6e9e2608326f (e938b99c-8977-4377-8f01-6e9e2608326f): created successfully Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfbab6f-7caf-45b7-99c6-f65ce5d91062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (cc5be1d3-a26e-4dbd-b024-bf38c81b2067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-90b74314-7e19-491b-929b-20d6e92c8d61 tempest-GroupSnapshotsTest-1873383423 None] Created volume successfully. Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-c199f026-a9e1-4e6d-97f0-d72a1187f35b-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-c199f026-a9e1-4e6d-97f0-d72a1187f35b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-c199f026-a9e1-4e6d-97f0-d72a1187f35b" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-c199f026-a9e1-4e6d-97f0-d72a1187f35b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Deleting offline snapshot c199f026-a9e1-4e6d-97f0-d72a1187f35b of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] snapshot_file for this snap is: volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[87100ba2-1fd8-45ad-9809-08a7839d91f5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:45 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b Nov 02 10:39:45 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:45 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b" returned: 0 in 0.727s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[403be871-e0b8-4acb-acd8-a2482e7d3c79]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:45 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:45 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (1b5d3756-4fd2-4998-bb08-577200e5f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:46 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ff3b76-d4bc-4bd7-887b-a6d3dbab08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.629s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ff3b76-d4bc-4bd7-887b-a6d3dbab08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596474806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67455448-e231-423c-a4bd-c3f498c0b018,host='devstack@QuobyteHD#QuobyteHD',id=18bff3bb-4fc4-4163-83b7-28fb92eb9f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:46Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c4d2f55-33e1-4880-8885-ba224dc58a80),volume_type_id=4c4d2f55-33e1-4880-8885-ba224dc58a80)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a011f6fd-674c-4c65-95ba-55298be4df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a011f6fd-674c-4c65-95ba-55298be4df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:46 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b Nov 02 10:39:46 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1edd9f-1f87-4cbe-b2ac-a32b9a3dee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1edd9f-1f87-4cbe-b2ac-a32b9a3dee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bff3bb-4fc4-4163-83b7-28fb92eb9f2a', 'volume_name': 'volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb423113-1116-45d5-a480-b6dd19edff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb423113-1116-45d5-a480-b6dd19edff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6125b7e2-1e34-44ae-a77a-955ee704f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:46 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Volume 18bff3bb-4fc4-4163-83b7-28fb92eb9f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a', 'volume_size': 1} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67455448-e231-423c-a4bd-c3f498c0b018,created_at=2026-11-02T09:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596474806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67455448-e231-423c-a4bd-c3f498c0b018,host='devstack@QuobyteHD#QuobyteHD',id=18bff3bb-4fc4-4163-83b7-28fb92eb9f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:39:46Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c4d2f55-33e1-4880-8885-ba224dc58a80),volume_type_id=4c4d2f55-33e1-4880-8885-ba224dc58a80)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Creating volume 18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:39:46 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:46 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a 1073741824 Nov 02 10:39:46 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:46 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b" returned: 0 in 0.601s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:46 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b Nov 02 10:39:46 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:46 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a 1073741824" returned: 0 in 0.650s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:47 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a Nov 02 10:39:47 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:47 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.c199f026-a9e1-4e6d-97f0-d72a1187f35b" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-c199f026-a9e1-4e6d-97f0-d72a1187f35b" released by "_delete_snapshot" :: held 2.420s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" released by "delete_snapshot" :: held 2.457s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Created reservations ['a8c6aaf3-81c1-4f13-afe3-232d78accdd5', 'ebc54c63-b16d-4a23-878e-d23ecd461a58', 'e9c013e4-210f-466e-accf-91ee105bb381', 'a52f4202-3b84-40ae-a893-b7b06fc870cb'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Delete snapshot completed successfully. Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-414e3dea-41d3-4878-9089-4c7a77ca8ef6 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-c199f026-a9e1-4e6d-97f0-d72a1187f35b-delete_snapshot" released by "delete_snapshot" :: held 2.615s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:47 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" returned: 0 in 0.301s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6125b7e2-1e34-44ae-a77a-955ee704f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f354ee4b-df86-45f8-81a1-63693e0e60d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:39:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Volume volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a (18bff3bb-4fc4-4163-83b7-28fb92eb9f2a): created successfully Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f354ee4b-df86-45f8-81a1-63693e0e60d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:39:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (1b5d3756-4fd2-4998-bb08-577200e5f691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:39:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7f90b617-d450-45f4-9ed3-476d6428e442 tempest-GroupSnapshotsTest-1873383423 None] Created volume successfully. Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Creating offline snapshot 9e8e6b83-269c-4d7a-b079-db84c3c628ca of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[791222b3-20b0-4a1c-9874-9185fe6b884b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:48 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:48 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-76b73cf5-201a-4bb1-894c-f4438ab15d9f tempest-GroupSnapshotsTest-1873383423 None] Update group completed successfully. Nov 02 10:39:48 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.463s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:48 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca 1G Nov 02 10:39:48 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-a0c530f4-8052-43fd-aff4-4d126c428a89 req-cc807e78-60d2-416e-8941-ee7e6c36a130 tempest-AttachVolumeNegativeTest-315741834 None] Terminate volume connection completed successfully. Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-a0c530f4-8052-43fd-aff4-4d126c428a89 req-cc807e78-60d2-416e-8941-ee7e6c36a130 tempest-AttachVolumeNegativeTest-315741834 None] Deleting attachment 286fc5e7-cc03-470b-9df4-45f4719f190b. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:39:49 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca 1G" returned: 0 in 0.492s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:49 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca Nov 02 10:39:49 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:49 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:49 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca is being set with open permissions: ugo+rw Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:49 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca Nov 02 10:39:49 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:49 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca" returned: 0 in 0.248s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.621s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b3191f30-826f-4dd7-88dd-098c417786df tempest-SnapshotsActionsTest-805761989 None] Create snapshot completed successfully Nov 02 10:39:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a09b0cb2-9b94-40de-bd86-15f87a26ea1e tempest-GroupSnapshotsTest-1873383423 None] Update group completed successfully. Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-9e8e6b83-269c-4d7a-b079-db84c3c628ca-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-9e8e6b83-269c-4d7a-b079-db84c3c628ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-9e8e6b83-269c-4d7a-b079-db84c3c628ca" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-9e8e6b83-269c-4d7a-b079-db84c3c628ca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Deleting offline snapshot 9e8e6b83-269c-4d7a-b079-db84c3c628ca of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] snapshot_file for this snap is: volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a8d27-93d9-44c9-b13f-3d893bbb78b7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:50 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca Nov 02 10:39:50 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7db09240-8089-4797-bf5f-5e908dac1247 tempest-GroupSnapshotsTest-1873383423 None] Update group completed successfully. Nov 02 10:39:51 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca" returned: 0 in 0.445s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[2463f9b6-e3b3-43cb-a2df-e43779457fdd]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:51 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:51 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:51 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:51 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca Nov 02 10:39:51 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:52 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca" returned: 0 in 0.458s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:52 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca Nov 02 10:39:52 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-25ae9bbf-0e04-414d-9e32-31b63c67a24d tempest-GroupSnapshotsTest-1873383423 None] Update group completed successfully. Nov 02 10:39:52 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.9e8e6b83-269c-4d7a-b079-db84c3c628ca" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-9e8e6b83-269c-4d7a-b079-db84c3c628ca" released by "_delete_snapshot" :: held 1.813s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" released by "delete_snapshot" :: held 1.841s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Created reservations ['ed72d745-686f-424e-b49c-c9b975a63c26', '8614b013-c11c-4b8b-b681-6d5f02b76991', '58725431-d59f-41cb-943f-6fdc779b1b24', 'dd6d5321-e092-4629-a49f-99e6fe9527b7'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Delete snapshot completed successfully. Nov 02 10:39:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a7739350-662c-4ed1-b2da-f575922a4897 tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-9e8e6b83-269c-4d7a-b079-db84c3c628ca-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Creating offline snapshot 42c29475-4904-46b2-a831-97083b420dba of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b884856-6b20-4ee7-8aca-0ca606062f1b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:53 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:53 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:53 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.402s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:53 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba 1G Nov 02 10:39:53 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] GroupSnapshot 0b7cb60b-15e4-4f84-9a64-4fb67c8f6f69: creating. Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Group snapshot 0b7cb60b-15e4-4f84-9a64-4fb67c8f6f69: creating. {{(pid=86926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:54 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba 1G" returned: 0 in 0.542s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:54 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba Nov 02 10:39:54 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:54 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba" returned: 0 in 0.371s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:54 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba is being set with open permissions: ugo+rw Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:54 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba Nov 02 10:39:54 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:54 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba" returned: 0 in 0.313s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.756s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.815s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Creating offline snapshot ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c of volume 18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4b25ef21-8784-4f2b-848b-eb66c5beb1bc tempest-SnapshotsActionsTest-805761989 None] Create snapshot completed successfully Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa0ce96-2a57-4d3a-b29e-28717e85870d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:55 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a Nov 02 10:39:55 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-42c29475-4904-46b2-a831-97083b420dba-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-42c29475-4904-46b2-a831-97083b420dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Acquiring lock "cinder-quobyte-42c29475-4904-46b2-a831-97083b420dba" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-42c29475-4904-46b2-a831-97083b420dba" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Deleting offline snapshot 42c29475-4904-46b2-a831-97083b420dba of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] snapshot_file for this snap is: volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[90905690-fa29-4de0-a3e6-f21b14c55cb7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:55 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" returned: 0 in 0.683s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:55 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba Nov 02 10:39:55 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c 1G Nov 02 10:39:55 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:55 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:55 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed8f69-c03d-44db-b529-4d86ce1b1dc1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:56 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c 1G" returned: 0 in 0.526s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:56 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c Nov 02 10:39:56 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:56 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:56 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:56 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.518s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:56 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" returned: 0 in 0.422s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:56 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:56 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba Nov 02 10:39:56 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:56 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c Nov 02 10:39:56 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:56 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" returned: 0 in 0.334s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:56 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info Nov 02 10:39:56 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:56 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba" returned: 0 in 0.477s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:57 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba Nov 02 10:39:57 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:57 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info" returned: 0 in 0.293s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:57 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:57 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info Nov 02 10:39:57 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:57 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.42c29475-4904-46b2-a831-97083b420dba" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-42c29475-4904-46b2-a831-97083b420dba" released by "_delete_snapshot" :: held 1.922s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" released by "delete_snapshot" :: held 1.994s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Created reservations ['f60d40dd-67b4-4ab9-b9bb-2d38a1f0d1a8', '1a92cbae-93ab-4c02-90c1-69d8fb02530a', '5c177f58-1b05-4e76-a4fe-2e1bacd92024', '89824162-e830-49fb-b86b-fce78c5b6960'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:39:57 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.info" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Creating offline snapshot fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 of volume e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:39:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Delete snapshot completed successfully. Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-136e8110-81c9-408d-b51b-0216c4cb867e tempest-SnapshotsActionsTest-2068532532 None] Lock "cinder-42c29475-4904-46b2-a831-97083b420dba-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[125be4e9-8d85-401a-abff-7b80a8b9800d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:57 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f Nov 02 10:39:57 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:58 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f" returned: 0 in 0.545s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:58 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 1G Nov 02 10:39:58 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:59 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 1G" returned: 0 in 0.786s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e938b99c-8977-4377-8f01-6e9e2608326f -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:59 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e938b99c-8977-4377-8f01-6e9e2608326f -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 Nov 02 10:39:59 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "cinder-25a4fd3a-1826-4c8f-b0aa-16039b2218b4-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:59 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e938b99c-8977-4377-8f01-6e9e2608326f -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" returned: 0 in 0.506s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:59 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-25a4fd3a-1826-4c8f-b0aa-16039b2218b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:59 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 Nov 02 10:39:59 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "cinder-quobyte-25a4fd3a-1826-4c8f-b0aa-16039b2218b4" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-quobyte-25a4fd3a-1826-4c8f-b0aa-16039b2218b4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Deleting offline snapshot 25a4fd3a-1826-4c8f-b0aa-16039b2218b4 of volume 4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] snapshot_file for this snap is: volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70bf266-7d5a-47f5-a768-f3bdf362c1c8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:39:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:59 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:39:59 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:00 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" returned: 0 in 0.517s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:00 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info Nov 02 10:40:00 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:00 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.518s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842b68f-d4b7-4f3a-983d-fe513a252eb5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:00 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe Nov 02 10:40:00 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:00 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info" returned: 0 in 0.506s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:00 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:00 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info Nov 02 10:40:00 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:00 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" returned: 0 in 0.609s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:00 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:40:00 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:01 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.info" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6dcd8f44-2873-4bd8-a7e7-9218ee1240f1 tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 0b7cb60b-15e4-4f84-9a64-4fb67c8f6f69: created successfully Nov 02 10:40:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-79c83c60-370b-485c-87c4-5966d7887315 tempest-ServerActionsTestOtherA-1127498219 None] Terminate volume connection completed successfully. Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-79c83c60-370b-485c-87c4-5966d7887315 tempest-ServerActionsTestOtherA-1127498219 None] Deleting attachment 2a8a9c7f-2893-496f-b9f9-451685275085. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:40:01 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.496s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:01 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4 Nov 02 10:40:01 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "cinder-5c91da8f-f0c0-441a-a50c-601a4ed25040-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-5c91da8f-f0c0-441a-a50c-601a4ed25040-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "cinder-quobyte-5c91da8f-f0c0-441a-a50c-601a4ed25040" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-quobyte-5c91da8f-f0c0-441a-a50c-601a4ed25040" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0019ae-ae27-423e-9020-1e26deb08a88]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:01 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 0b7cb60b-15e4-4f84-9a64-4fb67c8f6f69: deleting Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe.25a4fd3a-1826-4c8f-b0aa-16039b2218b4" returned: 0 in 0.412s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 0b7cb60b-15e4-4f84-9a64-4fb67c8f6f69: deleting {{(pid=86926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-quobyte-25a4fd3a-1826-4c8f-b0aa-16039b2218b4" released by "_delete_snapshot" :: held 2.266s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" released by "delete_snapshot" :: held 2.318s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:02 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 Nov 02 10:40:02 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Deleting offline snapshot ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c of volume 18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] snapshot_file for this snap is: volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5221ec33-61d4-4a14-a959-db06230d9449]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Created reservations ['cee55a5d-f8e2-437c-94d4-7ec1f971eae4', '966bf047-c0c0-469a-874b-be55dd368302', '539b27cd-83fa-4ba3-ae85-6019970dbb08', '980ce1a8-ba06-4693-a0cb-c8c214e8e0d2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Delete snapshot completed successfully. Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4409edd0-27db-457b-b823-b385710ef39f tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-25a4fd3a-1826-4c8f-b0aa-16039b2218b4-delete_snapshot" released by "delete_snapshot" :: held 2.691s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:02 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c Nov 02 10:40:02 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:02 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040" returned: 0 in 0.649s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:02 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040 Nov 02 10:40:02 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "cinder-43e86944-baa9-42ce-9ef0-c1e20b6e07db-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-43e86944-baa9-42ce-9ef0-c1e20b6e07db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "cinder-quobyte-43e86944-baa9-42ce-9ef0-c1e20b6e07db" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-quobyte-43e86944-baa9-42ce-9ef0-c1e20b6e07db" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef6c57-9cec-4f12-91fc-3f3c2ec5fc81]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:02 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" returned: 0 in 0.726s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062d5f4-768b-4791-b0e3-dbcd4bb0fee2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:02 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:02 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db Nov 02 10:40:02 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "cinder-4ee812c6-2673-44b2-90c4-8a06e6fcedfe-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5c91da8f-f0c0-441a-a50c-601a4ed25040" returned: 0 in 0.537s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-quobyte-5c91da8f-f0c0-441a-a50c-601a4ed25040" released by "delete_volume" :: held 1.274s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-4ee812c6-2673-44b2-90c4-8a06e6fcedfe-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:03 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a Nov 02 10:40:03 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.quota [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Created reservations ['11ad756d-561c-43b6-876a-1d35a57de81e', '4f5af5db-da73-49b2-9700-07715b85f977', 'e56935ae-538c-4d11-83ec-22e472f9ad0f', '05334157-772a-4a3d-8d6b-8f7603cbf883'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fdf651-5256-43dd-a2d4-1003f68c36be]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:03 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db" returned: 0 in 0.530s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:03 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:03 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:03 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db Nov 02 10:40:03 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:03 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe Nov 02 10:40:03 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:03 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" returned: 0 in 0.565s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:03 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c Nov 02 10:40:03 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:03 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-43e86944-baa9-42ce-9ef0-c1e20b6e07db" returned: 0 in 0.360s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:03 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.399s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.manager [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-quobyte-43e86944-baa9-42ce-9ef0-c1e20b6e07db" released by "delete_volume" :: held 0.981s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Deleted volume successfully. Nov 02 10:40:03 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-f92bde4c-c524-4172-aabf-3bd1e32f09a2 req-452c7637-fa45-4176-9c43-e4411a00ffce tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-5c91da8f-f0c0-441a-a50c-601a4ed25040-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" returned: 0 in 0.607s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:03 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe Nov 02 10:40:03 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Created reservations ['7c180239-d3c0-446a-ae9d-89556f47d2d0', 'b7a04546-3f5f-46f2-916a-4455b41031c3', '201b649c-cb03-4e39-b178-6551c0466197', 'd34b0d49-7363-4549-bb71-9b5aefd8b031'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:03 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:04 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:04 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:04 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" returned: 0 in 0.769s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:04 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" returned: 0 in 0.521s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:04 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c Nov 02 10:40:04 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-quobyte-4ee812c6-2673-44b2-90c4-8a06e6fcedfe" released by "delete_volume" :: held 1.255s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Created reservations ['de844bf3-6555-4d25-9423-455781ce40af', '393f2c87-7184-4b37-a261-30934bab9c38', '57c43f10-27af-4e0a-a9a2-6a6473d8c530', 'c33f756a-b64c-4928-a032-4d50b982a908'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=115,cinder:UPDATE=116,cinder:INSERT=30,cinder:DELETE=3 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:04 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:04 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:04 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.646s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Deleted volume successfully. Nov 02 10:40:04 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a.ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" returned: 0 in 0.596s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff253e17-b3f1-4e8d-8051-2a19d270b294 tempest-ServerActionsTestOtherA-1127498219 None] Lock "cinder-43e86944-baa9-42ce-9ef0-c1e20b6e07db-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-ad10d934-f6c0-407e-b1ae-29eb3c8f5d2c" released by "_delete_snapshot" :: held 2.866s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" released by "delete_snapshot" :: held 2.928s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-e938b99c-8977-4377-8f01-6e9e2608326f" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-e938b99c-8977-4377-8f01-6e9e2608326f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Deleting offline snapshot fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 of volume e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] snapshot_file for this snap is: volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:40:05 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[716b5dd2-9a18-400f-8fb3-1b89607b6686]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.557s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Deleted volume successfully. Nov 02 10:40:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2f4f81e6-2e55-441c-9790-e508d2d43a14 tempest-SnapshotsActionsTest-805761989 None] Lock "cinder-4ee812c6-2673-44b2-90c4-8a06e6fcedfe-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:05 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 Nov 02 10:40:05 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:06 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" returned: 0 in 1.165s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e938b99c-8977-4377-8f01-6e9e2608326f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:40:06 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5cd47-7527-433c-b8aa-2ec94430133e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:06 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f Nov 02 10:40:06 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:06 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f" returned: 0 in 0.491s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:07 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 Nov 02 10:40:07 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:07 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" returned: 0 in 0.679s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:07 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16 Nov 02 10:40:07 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:08 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f.fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" returned: 0 in 0.463s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-fcd6619d-4ddb-40a9-a6e5-aaf1c63f3d16" released by "_delete_snapshot" :: held 3.155s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-e938b99c-8977-4377-8f01-6e9e2608326f" released by "delete_snapshot" :: held 3.212s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:08 devstack cinder-volume[86926]: WARNING cinder.quota [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1020795967 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1020795967, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:08 devstack cinder-volume[86926]: WARNING cinder.quota [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1020795967 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1020795967, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:08 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['1c6b69ca-a529-4cc1-8067-b9814d54bfa1', '649b5db1-9edb-435e-adce-2947789a4723', '48819c15-c99b-46bf-ba19-7b9ca50b6419', '7619fe0e-4b42-4a3d-a647-56da0e857bb1'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:08 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['c7721f1e-a63d-4ff8-ba03-dbe961abf6b9', '0e3c97ab-7814-4acb-be19-1216b0d310db', '28a94968-2f87-429a-9523-a335955a3b33', 'aff49b66-9364-4236-a567-f5e021b6f573'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f529ae1c-f89d-4102-a02a-c98a60522a0f tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 0b7cb60b-15e4-4f84-9a64-4fb67c8f6f69: deleted successfully Nov 02 10:40:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a833db4d-abcf-4346-97bf-8cfadabd4f38]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:10 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a Nov 02 10:40:10 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:11 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" returned: 0 in 0.718s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:11 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a Nov 02 10:40:11 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:11 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" returned: 0 in 0.416s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-18bff3bb-4fc4-4163-83b7-28fb92eb9f2a" released by "delete_volume" :: held 1.277s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-e938b99c-8977-4377-8f01-6e9e2608326f" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-e938b99c-8977-4377-8f01-6e9e2608326f" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3fed1b-154b-41df-abf2-f4c4c1e4d155]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:11 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f Nov 02 10:40:11 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:12 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f" returned: 0 in 0.496s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:12 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f Nov 02 10:40:12 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:12 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e938b99c-8977-4377-8f01-6e9e2608326f" returned: 0 in 0.357s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-e938b99c-8977-4377-8f01-6e9e2608326f" released by "delete_volume" :: held 0.939s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['bdc78824-9700-4dd8-82b8-f2a7a978c945'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:12 devstack cinder-volume[86926]: WARNING cinder.quota [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1020795967 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1020795967, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['8c995b65-db72-45f2-9bff-6625b5fe0cae', 'c91a697f-2ed0-4e16-bec1-a4da0b6ef12e', 'ce5c7eda-fb85-4599-8ae8-102b16c0949f', '2559f70f-8e46-42e1-ac64-1755acd837c8'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['9f10ef44-2007-42c5-99f1-aee8cf14ad59', '8ff99a42-5710-4c35-ae53-3624a549483b', 'a4800004-7c7c-45a4-b980-be58245b0f74', 'dd711319-9e0d-40bc-8998-cd580ad38555'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:13 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:13 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:13 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.488s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7e066db2-1ab3-49de-9f72-669d94d725ba tempest-GroupSnapshotsTest-1873383423 None] Delete group completed successfully. Nov 02 10:40:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-71a335a0-8b67-4b05-86cb-96bf0e142cf3 tempest-GroupSnapshotsTest-1873383423 None] Group tempest-GroupSnapshotsTest-Group-1940778330: creating Nov 02 10:40:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-71a335a0-8b67-4b05-86cb-96bf0e142cf3 tempest-GroupSnapshotsTest-1873383423 None] Group tempest-GroupSnapshotsTest-Group-1940778330: created successfully Nov 02 10:40:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-71a335a0-8b67-4b05-86cb-96bf0e142cf3 tempest-GroupSnapshotsTest-1873383423 None] Create group completed successfully. Nov 02 10:40:16 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (f7b0957e-31af-461f-a62a-26c2358bb15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9402eb-b4b7-48f8-908d-6ed45dcbd33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9402eb-b4b7-48f8-908d-6ed45dcbd33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1164091391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c44cd90c-cd0c-48f8-a493-cac64429b287,host='devstack@QuobyteHD#QuobyteHD',id=cebe8fbb-2ad5-455e-9b16-564ebf31bea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:17Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aefa1af3-e825-42b4-97f9-cc181a71d3a2),volume_type_id=aefa1af3-e825-42b4-97f9-cc181a71d3a2)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f80337-5e19-405d-a421-493ed9c32df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f80337-5e19-405d-a421-493ed9c32df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f860b2-01fc-4357-8511-393efce1e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f860b2-01fc-4357-8511-393efce1e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebe8fbb-2ad5-455e-9b16-564ebf31bea7', 'volume_name': 'volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb08db2-ce98-4185-9e76-399edaea1bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb08db2-ce98-4185-9e76-399edaea1bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2cbc16-af73-4319-b6b3-f6c7ff182212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:17 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Volume cebe8fbb-2ad5-455e-9b16-564ebf31bea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7', 'volume_size': 1} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c44cd90c-cd0c-48f8-a493-cac64429b287,created_at=2026-11-02T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1164091391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c44cd90c-cd0c-48f8-a493-cac64429b287,host='devstack@QuobyteHD#QuobyteHD',id=cebe8fbb-2ad5-455e-9b16-564ebf31bea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b65f3b4768e4790890617645943e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:17Z,use_quota=True,user_id='e821bec9a4bf4c7cbf976fa8e8313b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aefa1af3-e825-42b4-97f9-cc181a71d3a2),volume_type_id=aefa1af3-e825-42b4-97f9-cc181a71d3a2)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Creating volume cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:17 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:17 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 1073741824 Nov 02 10:40:17 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:17 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 1073741824" returned: 0 in 0.612s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:17 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 Nov 02 10:40:17 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:18 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" returned: 0 in 0.437s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2cbc16-af73-4319-b6b3-f6c7ff182212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1a0e1b-3ccd-4794-84a5-e89b01d57abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:18 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Volume volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 (cebe8fbb-2ad5-455e-9b16-564ebf31bea7): created successfully Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1a0e1b-3ccd-4794-84a5-e89b01d57abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Flow 'volume_create_manager' (f7b0957e-31af-461f-a62a-26c2358bb15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6793b2f9-8d58-4b25-8c88-7a89b5ecae53 tempest-GroupSnapshotsTest-1873383423 None] Created volume successfully. Nov 02 10:40:19 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] GroupSnapshot 1c2e3f88-a2ec-41d8-b3f1-5cd7fb3fd65d: creating. Nov 02 10:40:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Group snapshot 1c2e3f88-a2ec-41d8-b3f1-5cd7fb3fd65d: creating. {{(pid=86926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:40:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Creating offline snapshot d6503de8-024e-4a7e-89e0-b88ca21250a7 of volume cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:40:19 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432d24e-42ac-4aa7-9efc-6f622dbe8098]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:20 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 Nov 02 10:40:20 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:20 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" returned: 0 in 0.402s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:20 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 1G Nov 02 10:40:20 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:20 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 1G" returned: 0 in 0.507s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:20 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 Nov 02 10:40:20 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:21 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7" returned: 0 in 0.359s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:21 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:40:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:21 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 Nov 02 10:40:21 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:21 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7" returned: 0 in 0.273s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:21 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info Nov 02 10:40:21 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:21 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:21 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:40:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:21 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info Nov 02 10:40:21 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:22 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.info" returned: 0 in 0.285s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7c1a5e50-d78c-45b8-a899-281b8f2202db tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 1c2e3f88-a2ec-41d8-b3f1-5cd7fb3fd65d: created successfully Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:22 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:22 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:22 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.297s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:40:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:40:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 1c2e3f88-a2ec-41d8-b3f1-5cd7fb3fd65d: deleting Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 1c2e3f88-a2ec-41d8-b3f1-5cd7fb3fd65d: deleting {{(pid=86926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-d6503de8-024e-4a7e-89e0-b88ca21250a7" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-d6503de8-024e-4a7e-89e0-b88ca21250a7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Deleting offline snapshot d6503de8-024e-4a7e-89e0-b88ca21250a7 of volume cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] snapshot_file for this snap is: volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a2229-7621-4abf-9dd3-28aae61447a0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:23 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 Nov 02 10:40:23 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:23 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7" returned: 0 in 0.449s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad4fc1-b2bf-4698-846e-c9d441200af7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:24 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 Nov 02 10:40:24 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:24 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" returned: 0 in 0.477s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:24 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 Nov 02 10:40:24 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Flow 'volume_create_manager' (efd84251-252e-4c5d-a73c-bca27c8262dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6945f19f-defb-4bc3-83af-f426f670a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6945f19f-defb-4bc3-83af-f426f670a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-550665855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5a767d-ec94-47a1-b707-dd226a803667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a13a531c6d456aaab6ac06b004a681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:25Z,use_quota=True,user_id='63ee06d7c4b94165b3d6ef2fe468418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7653a4b9-1caa-42c2-90c4-02bcb16ab8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7653a4b9-1caa-42c2-90c4-02bcb16ab8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f026f2-72c6-40f5-8411-89c7f496986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f026f2-72c6-40f5-8411-89c7f496986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5a767d-ec94-47a1-b707-dd226a803667', 'volume_name': 'volume-cf5a767d-ec94-47a1-b707-dd226a803667', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27506e10-bbe8-465f-891d-e8b6c617bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27506e10-bbe8-465f-891d-e8b6c617bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a78eff1-a975-4644-9273-d012e19458fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Volume cf5a767d-ec94-47a1-b707-dd226a803667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5a767d-ec94-47a1-b707-dd226a803667', 'volume_size': 1} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-550665855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5a767d-ec94-47a1-b707-dd226a803667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a13a531c6d456aaab6ac06b004a681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:25Z,use_quota=True,user_id='63ee06d7c4b94165b3d6ef2fe468418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Creating volume cf5a767d-ec94-47a1-b707-dd226a803667 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:24 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:24 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 1073741824 Nov 02 10:40:24 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:24 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7" returned: 0 in 0.441s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:24 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7 Nov 02 10:40:24 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:25 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7.d6503de8-024e-4a7e-89e0-b88ca21250a7" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-d6503de8-024e-4a7e-89e0-b88ca21250a7" released by "_delete_snapshot" :: held 1.794s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" released by "delete_snapshot" :: held 1.835s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:25 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 1073741824" returned: 0 in 0.531s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:25 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 Nov 02 10:40:25 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:25 devstack cinder-volume[86926]: WARNING cinder.quota [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-127131416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-127131416, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:25 devstack cinder-volume[86926]: WARNING cinder.quota [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-127131416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-127131416, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['941efe02-1303-4f2a-9985-bc1f61199e24', '29c0492f-3b03-4b29-92ef-c6961e2de4f5', 'ab565449-d229-4b63-af0a-231c8c1fefcd', '89971e56-26a0-4ba2-ba49-d7b6c663c0c7'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-55664303-6394-4660-b42c-f6d0640ad27b tempest-GroupSnapshotsTest-1873383423 None] group_snapshot 1c2e3f88-a2ec-41d8-b3f1-5cd7fb3fd65d: deleted successfully Nov 02 10:40:25 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a78eff1-a975-4644-9273-d012e19458fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5a767d-ec94-47a1-b707-dd226a803667', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff5e43e-208b-4288-8d22-1dc397ddc452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Volume volume-cf5a767d-ec94-47a1-b707-dd226a803667 (cf5a767d-ec94-47a1-b707-dd226a803667): created successfully Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff5e43e-208b-4288-8d22-1dc397ddc452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Flow 'volume_create_manager' (efd84251-252e-4c5d-a73c-bca27c8262dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-701e96ee-c5e6-469a-82aa-a9d29cb92420 tempest-VolumeQuotasAdminTestJSON-443395427 None] Created volume successfully. Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "cinder-quobyte-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f45046e-e339-4d90-9301-5b573939bbd7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:26 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 Nov 02 10:40:26 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:26 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" returned: 0 in 0.593s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:26 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7 Nov 02 10:40:26 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "cinder-cf5a767d-ec94-47a1-b707-dd226a803667-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "cinder-cf5a767d-ec94-47a1-b707-dd226a803667-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "cinder-quobyte-cf5a767d-ec94-47a1-b707-dd226a803667" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "cinder-quobyte-cf5a767d-ec94-47a1-b707-dd226a803667" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d9ef0-f191-4ea4-a354-2c86b12f7329]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:27 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" returned: 0 in 0.431s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Lock "cinder-quobyte-cebe8fbb-2ad5-455e-9b16-564ebf31bea7" released by "delete_volume" :: held 1.169s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:27 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 Nov 02 10:40:27 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['73bea4cb-991c-4220-95fa-32206a41f599'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:27 devstack cinder-volume[86926]: WARNING cinder.quota [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-127131416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-127131416, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Created reservations ['030d6f0a-c334-4e10-bc46-4363eb96b159', 'c5ed96cf-d547-4972-8919-bfdaa71d5ebf', 'b6264f38-8598-4f55-bbac-a20cc8f178eb', '5212e31c-0f7c-4567-b583-0c4e4259b956'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:27 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:27 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:27 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667" returned: 0 in 0.618s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:27 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667 Nov 02 10:40:27 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:27 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-449cade2-e152-4a7c-99da-b58a7ca6174c tempest-GroupSnapshotsTest-1873383423 None] Delete group completed successfully. Nov 02 10:40:27 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf5a767d-ec94-47a1-b707-dd226a803667" returned: 0 in 0.327s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "cinder-quobyte-cf5a767d-ec94-47a1-b707-dd226a803667" released by "delete_volume" :: held 1.039s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Created reservations ['04c182ac-1684-435f-9413-9582f7f2eb58', 'a488378f-8d1b-44d7-b669-2815b6e2dd8d', '47fab197-4817-4636-b91f-4da8404cc6e1', '27911830-4b54-4fff-b892-d9ed710ef1ab'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:28 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:28 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:28 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.298s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Deleted volume successfully. Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=171,cinder:UPDATE=161,cinder:INSERT=41,cinder:DELETE=8 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:40:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-55e4906f-4b2e-436f-b799-65b7bfa5e8db tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "cinder-cf5a767d-ec94-47a1-b707-dd226a803667-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Flow 'volume_create_manager' (67b2dbb4-79ff-4a7e-9727-0c5025879aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d85e0f-a452-4de6-b838-d58d05f3fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d85e0f-a452-4de6-b838-d58d05f3fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545366597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b391172-6135-496b-b7c0-89d4bb8a7ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a13a531c6d456aaab6ac06b004a681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:30Z,use_quota=True,user_id='63ee06d7c4b94165b3d6ef2fe468418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62979681-72e8-4cef-9f28-268bbd6d37b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62979681-72e8-4cef-9f28-268bbd6d37b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec73961-dbda-490d-9edb-2c2c0cbcc3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec73961-dbda-490d-9edb-2c2c0cbcc3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b391172-6135-496b-b7c0-89d4bb8a7ca3', 'volume_name': 'volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a747a36-1463-4361-be55-919eb5e0d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a747a36-1463-4361-be55-919eb5e0d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ee1f96-28b1-4b8d-bd8f-da7ce31c21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Volume 6b391172-6135-496b-b7c0-89d4bb8a7ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3', 'volume_size': 1} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545366597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b391172-6135-496b-b7c0-89d4bb8a7ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a13a531c6d456aaab6ac06b004a681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:30Z,use_quota=True,user_id='63ee06d7c4b94165b3d6ef2fe468418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Creating volume 6b391172-6135-496b-b7c0-89d4bb8a7ca3 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:30 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:30 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 1073741824 Nov 02 10:40:30 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Flow 'volume_create_manager' (48d4c2dc-502b-4a4d-965f-d47b0fee2c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692eb097-ae8a-4008-85a5-e91f58785f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692eb097-ae8a-4008-85a5-e91f58785f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-297306428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1f40d1-cce4-4eee-b772-2b9c51e62fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc57107de2a44baa0c9c272e65be283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:31Z,use_quota=True,user_id='b1f10325806d431b934073d190ddee91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2167e0c3-4d05-4b1f-9841-121eb5b165b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2167e0c3-4d05-4b1f-9841-121eb5b165b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2a422b-7b75-4660-ab91-f6c7fa1bd498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2a422b-7b75-4660-ab91-f6c7fa1bd498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1f40d1-cce4-4eee-b772-2b9c51e62fc5', 'volume_name': 'volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d002590-65c3-4583-b914-5c9774fdf189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d002590-65c3-4583-b914-5c9774fdf189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9011a19a-4490-4805-b5d9-ec447dd43993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:31 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Volume 0b1f40d1-cce4-4eee-b772-2b9c51e62fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5', 'volume_size': 1} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 1073741824" returned: 0 in 0.831s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:31 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 Nov 02 10:40:31 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:31 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3" returned: 0 in 0.407s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-297306428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1f40d1-cce4-4eee-b772-2b9c51e62fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc57107de2a44baa0c9c272e65be283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:31Z,use_quota=True,user_id='b1f10325806d431b934073d190ddee91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Creating volume 0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:31 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ee1f96-28b1-4b8d-bd8f-da7ce31c21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 1073741824 Nov 02 10:40:31 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80c7ffe-66f8-4aee-bee8-d1ca663b1ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:31 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Volume volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 (6b391172-6135-496b-b7c0-89d4bb8a7ca3): created successfully Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80c7ffe-66f8-4aee-bee8-d1ca663b1ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Flow 'volume_create_manager' (67b2dbb4-79ff-4a7e-9727-0c5025879aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:31 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5d5595ac-16e0-4170-b896-4382fd80db0b tempest-VolumeQuotasAdminTestJSON-443395427 None] Created volume successfully. Nov 02 10:40:32 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 1073741824" returned: 0 in 0.624s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:32 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 Nov 02 10:40:32 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:32 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5" returned: 0 in 0.357s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9011a19a-4490-4805-b5d9-ec447dd43993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dc6387-b4a1-46b8-8575-145b57c13798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:32 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Volume volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 (0b1f40d1-cce4-4eee-b772-2b9c51e62fc5): created successfully Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dc6387-b4a1-46b8-8575-145b57c13798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Flow 'volume_create_manager' (48d4c2dc-502b-4a4d-965f-d47b0fee2c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fd8bdc55-dd6a-4452-8a21-1b282928824d tempest-AttachVolumeNegativeTest-315741834 None] Created volume successfully. Nov 02 10:40:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1ac63546-f866-48e0-8a06-ff30e97f020c tempest-VolumeQuotasAdminTestJSON-831838187 None] Transfer volume completed successfully. Nov 02 10:40:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Acquiring lock "cinder-6b391172-6135-496b-b7c0-89d4bb8a7ca3-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Lock "cinder-6b391172-6135-496b-b7c0-89d4bb8a7ca3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Acquiring lock "cinder-quobyte-6b391172-6135-496b-b7c0-89d4bb8a7ca3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Lock "cinder-quobyte-6b391172-6135-496b-b7c0-89d4bb8a7ca3" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9275ccf-9bf2-43aa-93c6-6a30f0c0c9db]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:34 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 Nov 02 10:40:34 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3486fe78-526e-4a55-8700-4b7da7db95fa req-559ecac5-3995-486e-891b-2d770e287f6b tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3486fe78-526e-4a55-8700-4b7da7db95fa req-559ecac5-3995-486e-891b-2d770e287f6b tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3486fe78-526e-4a55-8700-4b7da7db95fa req-559ecac5-3995-486e-891b-2d770e287f6b tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-3486fe78-526e-4a55-8700-4b7da7db95fa req-559ecac5-3995-486e-891b-2d770e287f6b tempest-AttachVolumeNegativeTest-315741834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '255b8580-0bac-4cdb-84ca-386a75d032b7', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:40:34 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3" returned: 0 in 0.530s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:34 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3 Nov 02 10:40:34 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-3486fe78-526e-4a55-8700-4b7da7db95fa req-559ecac5-3995-486e-891b-2d770e287f6b tempest-AttachVolumeNegativeTest-315741834 None] attachment_update completed successfully. Nov 02 10:40:34 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b391172-6135-496b-b7c0-89d4bb8a7ca3" returned: 0 in 0.425s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Lock "cinder-quobyte-6b391172-6135-496b-b7c0-89d4bb8a7ca3" released by "delete_volume" :: held 1.048s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Created reservations ['fc4598a6-a3de-4a7a-9948-f4a95b967ac4', '58b65632-f5ae-4aa3-b616-221ce0169d11', 'd3330398-daf4-48ce-a6b7-7c5ba7a94860', 'c9d0eaf1-68bc-413d-b73e-a7e57de6c47e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:35 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:35 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:35 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.344s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Deleted volume successfully. Nov 02 10:40:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-97350771-d9d5-497a-abda-7d3562aedd17 tempest-VolumeQuotasAdminTestJSON-561830889 None] Lock "cinder-6b391172-6135-496b-b7c0-89d4bb8a7ca3-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-f03e608a-e9ef-47e5-8d54-d85d7ae2f61b req-f838af9d-ba82-4c26-bb74-3cb5f8f6ea43 tempest-AttachVolumeNegativeTest-315741834 None] Terminate volume connection completed successfully. Nov 02 10:40:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-f03e608a-e9ef-47e5-8d54-d85d7ae2f61b req-f838af9d-ba82-4c26-bb74-3cb5f8f6ea43 tempest-AttachVolumeNegativeTest-315741834 None] Deleting attachment 255b8580-0bac-4cdb-84ca-386a75d032b7. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:40:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7037c676-82af-45b1-9b99-c2e53b2e1f28 tempest-GroupSnapshotsV319Test-1955637250 None] Group tempest-GroupSnapshotsV319Test-Group-1178404166: creating Nov 02 10:40:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7037c676-82af-45b1-9b99-c2e53b2e1f28 tempest-GroupSnapshotsV319Test-1955637250 None] Group tempest-GroupSnapshotsV319Test-Group-1178404166: created successfully Nov 02 10:40:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7037c676-82af-45b1-9b99-c2e53b2e1f28 tempest-GroupSnapshotsV319Test-1955637250 None] Create group completed successfully. Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Flow 'volume_create_manager' (27543926-0db0-400d-be76-f60725feb606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240de135-6ab6-44f9-bad1-1742181796d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240de135-6ab6-44f9-bad1-1742181796d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2128014478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfea4e3-5b6c-46f1-84c3-9668cc151d1c,host='devstack@QuobyteHD#QuobyteHD',id=a8d54bbc-f625-45a4-b3b4-712385654289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ebf554199c4fcb8ea529385e4a7603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:40Z,use_quota=True,user_id='accbf8fe7f0a4b0da5def4dc00778c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b5fc53e-ca2d-48a5-8f44-bc294b0b56ee),volume_type_id=6b5fc53e-ca2d-48a5-8f44-bc294b0b56ee)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60828fc1-82f7-4eff-895b-cbb9a143718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60828fc1-82f7-4eff-895b-cbb9a143718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4c54f0-26cd-41cc-915b-a0df5a3d502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4c54f0-26cd-41cc-915b-a0df5a3d502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d54bbc-f625-45a4-b3b4-712385654289', 'volume_name': 'volume-a8d54bbc-f625-45a4-b3b4-712385654289', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9936dcd-09a3-4bbf-89d0-6b372d826db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9936dcd-09a3-4bbf-89d0-6b372d826db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cc26fa-f116-4ae6-ad35-65b894c42ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Volume a8d54bbc-f625-45a4-b3b4-712385654289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d54bbc-f625-45a4-b3b4-712385654289', 'volume_size': 1} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bfea4e3-5b6c-46f1-84c3-9668cc151d1c,created_at=2026-11-02T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2128014478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfea4e3-5b6c-46f1-84c3-9668cc151d1c,host='devstack@QuobyteHD#QuobyteHD',id=a8d54bbc-f625-45a4-b3b4-712385654289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ebf554199c4fcb8ea529385e4a7603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:40Z,use_quota=True,user_id='accbf8fe7f0a4b0da5def4dc00778c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b5fc53e-ca2d-48a5-8f44-bc294b0b56ee),volume_type_id=6b5fc53e-ca2d-48a5-8f44-bc294b0b56ee)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Creating volume a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:40 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:40:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:40 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 1073741824 Nov 02 10:40:40 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:41 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 1073741824" returned: 0 in 0.608s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:41 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 Nov 02 10:40:41 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:41 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289" returned: 0 in 0.431s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cc26fa-f116-4ae6-ad35-65b894c42ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d54bbc-f625-45a4-b3b4-712385654289', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b92078-bff3-4f77-a5db-e0e05e9e2d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Volume volume-a8d54bbc-f625-45a4-b3b4-712385654289 (a8d54bbc-f625-45a4-b3b4-712385654289): created successfully Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b92078-bff3-4f77-a5db-e0e05e9e2d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Flow 'volume_create_manager' (27543926-0db0-400d-be76-f60725feb606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-70bac676-3f83-4820-8358-009cdda0eea8 tempest-GroupSnapshotsV319Test-1955637250 None] Created volume successfully. Nov 02 10:40:43 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] GroupSnapshot bfa25520-bf10-4673-ad4b-bd5d3e96cce7: creating. Nov 02 10:40:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Group snapshot bfa25520-bf10-4673-ad4b-bd5d3e96cce7: creating. {{(pid=86926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:40:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Creating offline snapshot 971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 of volume a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:40:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7034af-251a-462a-8105-2ac2cabb02a1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:43 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 Nov 02 10:40:43 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:44 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289" returned: 0 in 0.659s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:44 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 1G Nov 02 10:40:44 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:45 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 1G" returned: 0 in 0.828s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d54bbc-f625-45a4-b3b4-712385654289 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:45 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d54bbc-f625-45a4-b3b4-712385654289 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 Nov 02 10:40:45 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:45 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d54bbc-f625-45a4-b3b4-712385654289 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" returned: 0 in 0.691s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:45 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:40:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:46 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 Nov 02 10:40:46 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:46 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" returned: 0 in 0.350s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:46 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info Nov 02 10:40:46 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:46 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info" returned: 0 in 0.505s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:46 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:40:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:46 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info Nov 02 10:40:46 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:47 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.info" returned: 0 in 0.439s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.637s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bfde6d31-ad60-4199-afc9-a05a95f64141 tempest-GroupSnapshotsV319Test-1955637250 None] group_snapshot bfa25520-bf10-4673-ad4b-bd5d3e96cce7: created successfully Nov 02 10:40:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] group_snapshot bfa25520-bf10-4673-ad4b-bd5d3e96cce7: deleting Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] group_snapshot bfa25520-bf10-4673-ad4b-bd5d3e96cce7: deleting {{(pid=86926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "cinder-quobyte-a8d54bbc-f625-45a4-b3b4-712385654289" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "cinder-quobyte-a8d54bbc-f625-45a4-b3b4-712385654289" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "cinder-quobyte-971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "cinder-quobyte-971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Deleting offline snapshot 971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 of volume a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] snapshot_file for this snap is: volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f683e71c-6e36-404d-9567-bb4f8979bcfd]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:49 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 Nov 02 10:40:49 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:49 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8d54bbc-f625-45a4-b3b4-712385654289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab688e7e-aba4-4ae5-bec3-f4e015738b19]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:50 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 Nov 02 10:40:50 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:50 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289" returned: 0 in 0.468s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:50 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 Nov 02 10:40:50 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Flow 'volume_create_manager' (5af33763-0c4c-4c0f-91ae-d25720aaea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5bdbb5-0699-439f-8bc7-46dfce2e3516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:50 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" returned: 0 in 0.488s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5bdbb5-0699-439f-8bc7-46dfce2e3516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-771068968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4534049-43d4-461e-af20-a9f512fc8f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65dd9aeab828412288a78f9ad358a22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:51Z,use_quota=True,user_id='7944a8d9540a49bba3edfa2cb60c8cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd569314-9a51-453b-b353-db5758384d20),volume_type_id=dd569314-9a51-453b-b353-db5758384d20)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d79adbd-618e-4c74-b16d-d32ef4fee5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d79adbd-618e-4c74-b16d-d32ef4fee5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:50 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89 Nov 02 10:40:50 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dafc63a-a6d3-4448-b319-d47d8dec8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dafc63a-a6d3-4448-b319-d47d8dec8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4534049-43d4-461e-af20-a9f512fc8f55', 'volume_name': 'volume-f4534049-43d4-461e-af20-a9f512fc8f55', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27938657-447f-469a-bec8-dd298c5bd804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27938657-447f-469a-bec8-dd298c5bd804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dce4f45-2df7-42e6-8b4b-8a72291526ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Volume f4534049-43d4-461e-af20-a9f512fc8f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4534049-43d4-461e-af20-a9f512fc8f55', 'volume_size': 1} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-771068968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4534049-43d4-461e-af20-a9f512fc8f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65dd9aeab828412288a78f9ad358a22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:51Z,use_quota=True,user_id='7944a8d9540a49bba3edfa2cb60c8cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd569314-9a51-453b-b353-db5758384d20),volume_type_id=dd569314-9a51-453b-b353-db5758384d20)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Creating volume f4534049-43d4-461e-af20-a9f512fc8f55 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:51 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:51 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 1073741824 Nov 02 10:40:51 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:51 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289.971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "cinder-quobyte-971aa8b5-be8a-42e7-b4ef-a3d907ca4a89" released by "_delete_snapshot" :: held 1.937s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Lock "cinder-quobyte-a8d54bbc-f625-45a4-b3b4-712385654289" released by "delete_snapshot" :: held 1.979s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:51 devstack cinder-volume[86926]: WARNING cinder.quota [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1003666012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1003666012, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:51 devstack cinder-volume[86926]: WARNING cinder.quota [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1003666012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1003666012, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] Created reservations ['41de81ab-13be-403d-b182-258ad714a810', '506201ce-66bd-400b-bc04-dfea7b789e0b', '8ea16425-394b-4d7c-81f7-7dec1be3505a', '86d7cf18-dba6-4f68-aff8-93302263695b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f8693dbf-253a-4492-855e-9a3a5fd98dc4 tempest-GroupSnapshotsV319Test-1955637250 None] group_snapshot bfa25520-bf10-4673-ad4b-bd5d3e96cce7: deleted successfully Nov 02 10:40:51 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 1073741824" returned: 0 in 0.624s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:51 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 Nov 02 10:40:51 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:52 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55" returned: 0 in 0.351s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dce4f45-2df7-42e6-8b4b-8a72291526ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4534049-43d4-461e-af20-a9f512fc8f55', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8385749-32db-4109-a0c8-0d6e6993ff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:52 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Volume volume-f4534049-43d4-461e-af20-a9f512fc8f55 (f4534049-43d4-461e-af20-a9f512fc8f55): created successfully Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8385749-32db-4109-a0c8-0d6e6993ff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Flow 'volume_create_manager' (5af33763-0c4c-4c0f-91ae-d25720aaea5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dfd48512-2117-4f61-b2cb-b3d1104d40e5 tempest-VolumeTypesAccessTest-1286469728 None] Created volume successfully. Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "cinder-quobyte-a8d54bbc-f625-45a4-b3b4-712385654289" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Lock "cinder-quobyte-a8d54bbc-f625-45a4-b3b4-712385654289" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[be22b66a-1c36-4149-a7ed-ea8ea0633840]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:52 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 Nov 02 10:40:52 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Acquiring lock "cinder-f4534049-43d4-461e-af20-a9f512fc8f55-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Lock "cinder-f4534049-43d4-461e-af20-a9f512fc8f55-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Acquiring lock "cinder-quobyte-f4534049-43d4-461e-af20-a9f512fc8f55" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Lock "cinder-quobyte-f4534049-43d4-461e-af20-a9f512fc8f55" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:53 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289" returned: 0 in 0.693s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8eb375-8b39-4228-9b7c-debc77d92e0c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:53 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289 Nov 02 10:40:53 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:53 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 Nov 02 10:40:53 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:53 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a8d54bbc-f625-45a4-b3b4-712385654289" returned: 0 in 0.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Lock "cinder-quobyte-a8d54bbc-f625-45a4-b3b4-712385654289" released by "delete_volume" :: held 1.187s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Created reservations ['00d48abc-8590-4c8d-bc60-f9a1db2b22ad'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:53 devstack cinder-volume[86926]: WARNING cinder.quota [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1003666012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1003666012, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Created reservations ['4dbf3c62-528a-4c49-983d-34b15dd34cc2', 'aaa84002-8694-40d9-b753-245bc04fb021', '2d1b6546-6b39-4d5f-9975-5b2bd0e6635f', '206c4a9e-f411-4889-bf99-c47041fe41b5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:54 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:54 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:54 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55" returned: 0 in 0.760s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:54 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55 Nov 02 10:40:54 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:54 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:54 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f4534049-43d4-461e-af20-a9f512fc8f55" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.438s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Lock "cinder-quobyte-f4534049-43d4-461e-af20-a9f512fc8f55" released by "delete_volume" :: held 1.272s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1d4f3c14-d027-4504-ba40-8db0a7548d4c tempest-GroupSnapshotsV319Test-1955637250 None] Delete group completed successfully. Nov 02 10:40:54 devstack cinder-volume[86926]: WARNING cinder.quota [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-445638465 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-445638465, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:54 devstack cinder-volume[86926]: WARNING cinder.quota [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-445638465 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-445638465, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Created reservations ['9c5652f0-8ac8-416b-8a58-78c420445d80', '5014a0fd-9f96-43e4-a276-2cc55f11d5f7', '0b6f2712-feff-4295-919b-c9d8535f4dcc', '8c6f1c40-8f9f-41db-bb97-eda0a62c266a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:54 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:40:54 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:55 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.273s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:55 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Deleted volume successfully. Nov 02 10:40:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-addfc121-6c15-443d-925d-269176787118 tempest-VolumeTypesAccessTest-1286469728 None] Lock "cinder-f4534049-43d4-461e-af20-a9f512fc8f55-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:DELETE=5,cinder:SELECT=112,cinder:INSERT=29,cinder:UPDATE=118 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:05 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=41,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Flow 'volume_create_manager' (d423c3dd-8eff-4ec6-b0d9-46b91125603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304b369e-23ce-479f-8a3e-051395d7ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304b369e-23ce-479f-8a3e-051395d7ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-130052531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7271e00-c7cf-4046-91d2-4c6dd672631c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c1e806ad5b4c028f3469fc3c0b054e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:09Z,use_quota=True,user_id='1a8296f4f9fe4ec1a4e7e8de53ff1a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1b8eab-42e9-4c95-be0a-2568491dee51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1b8eab-42e9-4c95-be0a-2568491dee51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b9f301-2c1c-4ad0-8f71-4d695e9c4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b9f301-2c1c-4ad0-8f71-4d695e9c4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7271e00-c7cf-4046-91d2-4c6dd672631c', 'volume_name': 'volume-a7271e00-c7cf-4046-91d2-4c6dd672631c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9633b4-a9b2-4b12-8104-f3dffbf6e3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9633b4-a9b2-4b12-8104-f3dffbf6e3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d4fb0-8545-4379-aaa2-052da2995c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:09 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Volume a7271e00-c7cf-4046-91d2-4c6dd672631c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7271e00-c7cf-4046-91d2-4c6dd672631c', 'volume_size': 1} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-130052531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7271e00-c7cf-4046-91d2-4c6dd672631c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c1e806ad5b4c028f3469fc3c0b054e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:09Z,use_quota=True,user_id='1a8296f4f9fe4ec1a4e7e8de53ff1a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Creating volume a7271e00-c7cf-4046-91d2-4c6dd672631c {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:09 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:09 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c 1073741824 Nov 02 10:41:09 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:10 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c 1073741824" returned: 0 in 0.636s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:10 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c Nov 02 10:41:10 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:10 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d4fb0-8545-4379-aaa2-052da2995c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7271e00-c7cf-4046-91d2-4c6dd672631c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7a6f0c-d757-4ddc-b1d0-160d337cbdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:10 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Volume volume-a7271e00-c7cf-4046-91d2-4c6dd672631c (a7271e00-c7cf-4046-91d2-4c6dd672631c): created successfully Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7a6f0c-d757-4ddc-b1d0-160d337cbdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Flow 'volume_create_manager' (d423c3dd-8eff-4ec6-b0d9-46b91125603a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:10 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1df75264-488d-4799-a284-3d5bd9d8bcff tempest-AttachVolumeShelveTestJSON-1581696150 None] Created volume successfully. Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Flow 'volume_create_manager' (b6459da1-844c-4994-827b-53735f24b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70ec74a-590d-4bd3-a0de-6c7be27f316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70ec74a-590d-4bd3-a0de-6c7be27f316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573585987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0a6f94-5464-4dc8-b109-71aa30706f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0decf03e1a82431e83b2acf2a238c100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:15Z,use_quota=True,user_id='611875000b0a495eaa29f59ee35ae51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd04a3f7-d91f-4755-81ed-41d630556292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd04a3f7-d91f-4755-81ed-41d630556292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba96bf13-be6f-4bca-91c6-5615e468ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:14 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba96bf13-be6f-4bca-91c6-5615e468ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a0a6f94-5464-4dc8-b109-71aa30706f94', 'volume_name': 'volume-6a0a6f94-5464-4dc8-b109-71aa30706f94', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aca66e8-0f50-4868-a2d7-2554614003ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aca66e8-0f50-4868-a2d7-2554614003ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d71aad-bc15-498c-9305-668fbdce56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:15 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Volume 6a0a6f94-5464-4dc8-b109-71aa30706f94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a0a6f94-5464-4dc8-b109-71aa30706f94', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Trying to clone 6a0a6f94-5464-4dc8-b109-71aa30706f94 from image 6256c21e-7619-488e-bde7-257c3f79e20b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:41:15 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f51f09-f6e9-4ae5-96fb-9e98c363c34f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:15 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD Nov 02 10:41:15 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:15 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b is fetched for user 611875000b0a495eaa29f59ee35ae51a. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2eb35e-f6d5-47ca-945c-00d3c7f57331]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:16 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD Nov 02 10:41:16 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:16 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573585987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0a6f94-5464-4dc8-b109-71aa30706f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0decf03e1a82431e83b2acf2a238c100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:15Z,use_quota=True,user_id='611875000b0a495eaa29f59ee35ae51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Creating volume 6a0a6f94-5464-4dc8-b109-71aa30706f94 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:16 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:16 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 1073741824 Nov 02 10:41:16 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:16 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 1073741824" returned: 0 in 0.596s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:17 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 Nov 02 10:41:17 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:17 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94" returned: 0 in 0.312s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Attempting download of 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume 6a0a6f94-5464-4dc8-b109-71aa30706f94. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358a9d3-28ed-4129-870b-cc31c6d6c994]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:17 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw Nov 02 10:41:17 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:17 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw" returned: 0 in 0.468s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:17 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw Nov 02 10:41:17 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:18 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw" returned: 1 in 0.369s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_mory70rw' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e9d70f-d225-4661-9258-b38e0ce3b597]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:18 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD Nov 02 10:41:18 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:18 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] 6256c21e-7619-488e-bde7-257c3f79e20b was qcow2, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:41:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:18 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 Nov 02 10:41:18 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:21 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94" returned: 0 in 2.813s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_whhtruaddevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:41:21 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Converted 112.00 MB image at 39.76 MB/s Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:21 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 1G Nov 02 10:41:21 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Flow 'volume_create_manager' (119c568f-4e2f-44e1-b799-30ee0a7f5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46a25ca-6678-4619-a32a-c793f795c0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46a25ca-6678-4619-a32a-c793f795c0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-233070772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a306a877-9f1c-473a-950c-f3213607af91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc57107de2a44baa0c9c272e65be283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:22Z,use_quota=True,user_id='b1f10325806d431b934073d190ddee91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf866346-3c11-431a-8b15-e7f65744a8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf866346-3c11-431a-8b15-e7f65744a8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b4bdcb-ccd7-4a76-9c60-5dca7d5e3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b4bdcb-ccd7-4a76-9c60-5dca7d5e3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a306a877-9f1c-473a-950c-f3213607af91', 'volume_name': 'volume-a306a877-9f1c-473a-950c-f3213607af91', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6241b92-5097-490c-af07-47895e030be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6241b92-5097-490c-af07-47895e030be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29b3299-bc42-4332-9ba5-df5a160b68df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:21 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Volume a306a877-9f1c-473a-950c-f3213607af91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a306a877-9f1c-473a-950c-f3213607af91', 'volume_size': 1} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-233070772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a306a877-9f1c-473a-950c-f3213607af91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc57107de2a44baa0c9c272e65be283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:22Z,use_quota=True,user_id='b1f10325806d431b934073d190ddee91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Creating volume a306a877-9f1c-473a-950c-f3213607af91 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:21 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:21 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 1073741824 Nov 02 10:41:21 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:21 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 1G" returned: 0 in 0.455s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:21 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Downloaded image 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume 6a0a6f94-5464-4dc8-b109-71aa30706f94 successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b for user 611875000b0a495eaa29f59ee35ae51a is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Marking volume 6a0a6f94-5464-4dc8-b109-71aa30706f94 as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Copying metadata from image 6256c21e-7619-488e-bde7-257c3f79e20b to 6a0a6f94-5464-4dc8-b109-71aa30706f94. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Creating volume glance metadata for volume 6a0a6f94-5464-4dc8-b109-71aa30706f94 backed by image 6256c21e-7619-488e-bde7-257c3f79e20b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d71aad-bc15-498c-9305-668fbdce56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0a6f94-5464-4dc8-b109-71aa30706f94', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe666b49-d096-4c29-b92c-762586673069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Volume volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 (6a0a6f94-5464-4dc8-b109-71aa30706f94): created successfully Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe666b49-d096-4c29-b92c-762586673069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Flow 'volume_create_manager' (b6459da1-844c-4994-827b-53735f24b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dba25328-0408-4e62-9d31-e07aa6152794 tempest-VolumesImageMetadata-1418144764 None] Created volume successfully. Nov 02 10:41:22 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 1073741824" returned: 0 in 0.618s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:22 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:22 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:22 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 Nov 02 10:41:22 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:22 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:22 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.351s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29b3299-bc42-4332-9ba5-df5a160b68df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a306a877-9f1c-473a-950c-f3213607af91', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13a814c-e912-452d-820e-3a5deca8b3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Volume volume-a306a877-9f1c-473a-950c-f3213607af91 (a306a877-9f1c-473a-950c-f3213607af91): created successfully Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13a814c-e912-452d-820e-3a5deca8b3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Flow 'volume_create_manager' (119c568f-4e2f-44e1-b799-30ee0a7f5e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8a40bb3c-ae32-4aa7-af48-77e13de7922f tempest-AttachVolumeNegativeTest-315741834 None] Created volume successfully. Nov 02 10:41:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-f68a7a59-312b-490c-be3c-a5b6d47a439b req-fa13d482-2cb6-4e4f-9203-5fea05b144c3 tempest-AttachVolumeShelveTestJSON-1581696150 None] No connector for attachment e4829fe5-5e7d-4df6-8640-f59d58a276bc; skipping storage backend terminate_connection call. {{(pid=86926) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 10:41:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-f68a7a59-312b-490c-be3c-a5b6d47a439b req-fa13d482-2cb6-4e4f-9203-5fea05b144c3 tempest-AttachVolumeShelveTestJSON-1581696150 None] Deleting attachment e4829fe5-5e7d-4df6-8640-f59d58a276bc. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Acquiring lock "cinder-6a0a6f94-5464-4dc8-b109-71aa30706f94-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Lock "cinder-6a0a6f94-5464-4dc8-b109-71aa30706f94-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Acquiring lock "cinder-quobyte-6a0a6f94-5464-4dc8-b109-71aa30706f94" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Lock "cinder-quobyte-6a0a6f94-5464-4dc8-b109-71aa30706f94" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d51cb9-e6eb-4f94-93d7-c5e18ba953d8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:24 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 Nov 02 10:41:24 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:24 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94" returned: 0 in 0.461s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:24 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94 Nov 02 10:41:24 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Flow 'volume_create_manager' (ae5edb5b-434b-46d6-baae-0ed3da847c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470f8173-bfcd-465e-933d-e66e6fca6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470f8173-bfcd-465e-933d-e66e6fca6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-228314344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58d8d88-b2f5-4e78-a116-5687fbf5f91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48bd2220dd1479bb8303a52cd420a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:25Z,use_quota=True,user_id='3e8b9a875a424a1d9a79d07af761acde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4383ed-d580-4945-8055-8a7445300daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4383ed-d580-4945-8055-8a7445300daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7e6876-dfbf-47f4-a70d-5b4dd68a4bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7e6876-dfbf-47f4-a70d-5b4dd68a4bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58d8d88-b2f5-4e78-a116-5687fbf5f91c', 'volume_name': 'volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6e8cfb-b1dc-4a45-9941-37f5a796bab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6e8cfb-b1dc-4a45-9941-37f5a796bab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592acfc2-53d1-496e-96ba-3bb8a20530b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Volume b58d8d88-b2f5-4e78-a116-5687fbf5f91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c', 'volume_size': 1} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-228314344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58d8d88-b2f5-4e78-a116-5687fbf5f91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48bd2220dd1479bb8303a52cd420a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:25Z,use_quota=True,user_id='3e8b9a875a424a1d9a79d07af761acde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Creating volume b58d8d88-b2f5-4e78-a116-5687fbf5f91c {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:25 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d9e62092-c7c9-4ceb-bb01-a3af53f50834 req-aa5efb46-f4ed-4259-8e6b-b3bdbbecbc96 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:25 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c 1073741824 Nov 02 10:41:25 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:25 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6a0a6f94-5464-4dc8-b109-71aa30706f94" returned: 0 in 0.367s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Lock "cinder-quobyte-6a0a6f94-5464-4dc8-b109-71aa30706f94" released by "delete_volume" :: held 0.900s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Created reservations ['aa9e6064-6608-40c8-89db-b3b19dad3268', '2737c94d-cc36-4adf-9a99-ae65cea82a5c', 'a5e6cbab-b241-4577-a23f-97dbcbcec953', '474e467b-c10a-4de2-8958-31a7714bd8ab'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:25 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:25 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:25 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c 1073741824" returned: 0 in 0.613s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:25 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.361s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:25 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c Nov 02 10:41:25 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Deleted volume successfully. Nov 02 10:41:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3f8bef8-405f-45a5-912e-fa380aa4e477 tempest-VolumesImageMetadata-1418144764 None] Lock "cinder-6a0a6f94-5464-4dc8-b109-71aa30706f94-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:26 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c" returned: 0 in 0.324s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d9e62092-c7c9-4ceb-bb01-a3af53f50834 req-aa5efb46-f4ed-4259-8e6b-b3bdbbecbc96 tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.972s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592acfc2-53d1-496e-96ba-3bb8a20530b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b6b9d6-a855-4f43-b8b3-3a268240e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d9e62092-c7c9-4ceb-bb01-a3af53f50834 req-aa5efb46-f4ed-4259-8e6b-b3bdbbecbc96 tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Volume volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c (b58d8d88-b2f5-4e78-a116-5687fbf5f91c): created successfully Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b6b9d6-a855-4f43-b8b3-3a268240e89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Flow 'volume_create_manager' (ae5edb5b-434b-46d6-baae-0ed3da847c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8510e04a-63ae-4f5e-b607-7b74485b9b6b tempest-VolumesServicesTestJSON-307768749 None] Created volume successfully. Nov 02 10:41:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d9e62092-c7c9-4ceb-bb01-a3af53f50834 req-aa5efb46-f4ed-4259-8e6b-b3bdbbecbc96 tempest-AttachVolumeNegativeTest-315741834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-a306a877-9f1c-473a-950c-f3213607af91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faa5a7b7-450e-49ff-8ec1-562b1d5de983', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:41:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-d9e62092-c7c9-4ceb-bb01-a3af53f50834 req-aa5efb46-f4ed-4259-8e6b-b3bdbbecbc96 tempest-AttachVolumeNegativeTest-315741834 None] attachment_update completed successfully. Nov 02 10:41:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Acquiring lock "cinder-b58d8d88-b2f5-4e78-a116-5687fbf5f91c-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Lock "cinder-b58d8d88-b2f5-4e78-a116-5687fbf5f91c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Acquiring lock "cinder-quobyte-b58d8d88-b2f5-4e78-a116-5687fbf5f91c" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Lock "cinder-quobyte-b58d8d88-b2f5-4e78-a116-5687fbf5f91c" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:27 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dcc9cc-5e7b-40a5-a149-a4cb74f2d6d8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:27 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c Nov 02 10:41:27 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:28 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c" returned: 0 in 0.563s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:28 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c Nov 02 10:41:28 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:28 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b58d8d88-b2f5-4e78-a116-5687fbf5f91c" returned: 0 in 0.290s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Lock "cinder-quobyte-b58d8d88-b2f5-4e78-a116-5687fbf5f91c" released by "delete_volume" :: held 0.945s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Created reservations ['26f603ab-e8ce-4aa4-ab5f-0254c502ce2d', '8886c618-c373-4a72-a026-7465be45ca85', 'f948f152-828f-48cf-ae43-dc221df98028', '56b7f75b-6158-4c98-96ae-6707eec104ee'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:28 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:28 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:29 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.485s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Deleted volume successfully. Nov 02 10:41:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-969d6c59-f13c-4e73-941a-539bf084656a tempest-VolumesServicesTestJSON-307768749 None] Lock "cinder-b58d8d88-b2f5-4e78-a116-5687fbf5f91c-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-e48f673a-7e6e-44d0-86b3-73dcac555b31 req-081f72c6-29fb-4b24-ba05-2e3b6742ed22 tempest-AttachVolumeNegativeTest-315741834 None] Terminate volume connection completed successfully. Nov 02 10:41:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-e48f673a-7e6e-44d0-86b3-73dcac555b31 req-081f72c6-29fb-4b24-ba05-2e3b6742ed22 tempest-AttachVolumeNegativeTest-315741834 None] Deleting attachment faa5a7b7-450e-49ff-8ec1-562b1d5de983. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Flow 'volume_create_manager' (d508dcc6-f2a1-4cd6-9194-b5e69e4cb877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dd89cb-a218-4b01-a325-61502c28ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dd89cb-a218-4b01-a325-61502c28ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-621736467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459c3053-63d7-4877-917a-6ad640e7926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5660d2c19231432d98c4e569f98e8d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:32Z,use_quota=True,user_id='2650c82616424eb884e7e9d8edeb89f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f725e7-0390-4ac2-8842-92277cd49191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f725e7-0390-4ac2-8842-92277cd49191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574daf51-e8be-4f7e-909a-aac4812b45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574daf51-e8be-4f7e-909a-aac4812b45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459c3053-63d7-4877-917a-6ad640e7926b', 'volume_name': 'volume-459c3053-63d7-4877-917a-6ad640e7926b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab152966-5c05-4bdd-807f-ae573e10f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab152966-5c05-4bdd-807f-ae573e10f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d08e00-c219-41e1-9855-2d2d47c36c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:32 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Volume 459c3053-63d7-4877-917a-6ad640e7926b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459c3053-63d7-4877-917a-6ad640e7926b', 'volume_size': 1} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-621736467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459c3053-63d7-4877-917a-6ad640e7926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5660d2c19231432d98c4e569f98e8d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:32Z,use_quota=True,user_id='2650c82616424eb884e7e9d8edeb89f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Creating volume 459c3053-63d7-4877-917a-6ad640e7926b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:32 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:32 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b 1073741824 Nov 02 10:41:32 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:33 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b 1073741824" returned: 0 in 0.841s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:33 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b Nov 02 10:41:33 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:33 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b" returned: 0 in 0.349s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d08e00-c219-41e1-9855-2d2d47c36c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459c3053-63d7-4877-917a-6ad640e7926b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45c6444-0f6f-4d0e-845e-87d3475226d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:33 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Volume volume-459c3053-63d7-4877-917a-6ad640e7926b (459c3053-63d7-4877-917a-6ad640e7926b): created successfully Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45c6444-0f6f-4d0e-845e-87d3475226d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Flow 'volume_create_manager' (d508dcc6-f2a1-4cd6-9194-b5e69e4cb877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ade70e82-0d31-4d47-b117-4b8115bef0ad tempest-VolumesMetadataTest-1056093148 None] Created volume successfully. Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "cinder-a306a877-9f1c-473a-950c-f3213607af91-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-a306a877-9f1c-473a-950c-f3213607af91-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Acquiring lock "cinder-459c3053-63d7-4877-917a-6ad640e7926b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "cinder-quobyte-a306a877-9f1c-473a-950c-f3213607af91" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Lock "cinder-459c3053-63d7-4877-917a-6ad640e7926b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-quobyte-a306a877-9f1c-473a-950c-f3213607af91" acquired by "delete_volume" :: waited 0.041s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Acquiring lock "cinder-quobyte-459c3053-63d7-4877-917a-6ad640e7926b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3433bd81-f17b-4164-8e63-862b41bcaf73]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Lock "cinder-quobyte-459c3053-63d7-4877-917a-6ad640e7926b" acquired by "delete_volume" :: waited 0.147s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1983c3-6bce-426f-b426-a7c23fb128c9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:36 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 Nov 02 10:41:36 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:36 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b Nov 02 10:41:36 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:36 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91" returned: 0 in 1.036s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:36 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b" returned: 0 in 0.942s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:37 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91 Nov 02 10:41:37 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:37 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b Nov 02 10:41:37 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:37 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-459c3053-63d7-4877-917a-6ad640e7926b" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Lock "cinder-quobyte-459c3053-63d7-4877-917a-6ad640e7926b" released by "delete_volume" :: held 1.429s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:37 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a306a877-9f1c-473a-950c-f3213607af91" returned: 0 in 0.502s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-quobyte-a306a877-9f1c-473a-950c-f3213607af91" released by "delete_volume" :: held 1.661s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Created reservations ['da3d2869-eefb-4126-8d3e-b6a120a5b759', '6ed4963d-2537-4775-b518-b646556c7105', '5bbc68b5-2936-4f65-af82-5ae182ea1734', '946401e8-6d13-4f8e-ad9f-71b98cacf4d2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Created reservations ['fb860045-6a23-43de-8b9d-f37c8d5d33a8', '5ee5b13a-baff-4117-9e70-379db8da6329', 'e1905a86-403e-471c-a52c-3085b07a9e81', '2c7d53e6-5c07-4e27-ad01-e54ea81bba74'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:37 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:37 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:37 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:37 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:38 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "cinder-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.640s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Deleted volume successfully. Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b72e7ed9-f003-4e46-b241-458aa695050b tempest-VolumesMetadataTest-1056093148 None] Lock "cinder-459c3053-63d7-4877-917a-6ad640e7926b-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "cinder-quobyte-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-quobyte-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:38 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.794s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Deleted volume successfully. Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4180ebbd-fe98-4f95-8c1a-7a57caf7e72b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-75f444f7-ef9d-407c-a75e-79af5ffa680b tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-a306a877-9f1c-473a-950c-f3213607af91-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:38 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 Nov 02 10:41:38 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:39 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5" returned: 0 in 0.512s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:39 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5 Nov 02 10:41:39 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:39 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5" returned: 0 in 0.334s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-quobyte-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5" released by "delete_volume" :: held 0.977s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Created reservations ['9ce55d45-277e-4122-9e74-6384b914c106', '1e7e311f-caef-423a-93d0-c0ba3edfc005', '9765cdb5-6f32-443f-9968-a3f596b0481a', '197298f2-4ec8-4a9d-b052-e5ba0f1e081d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:39 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:39 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:40 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.354s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:40 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:40 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Deleted volume successfully. Nov 02 10:41:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-47325d23-07f3-4113-acb3-8046d1cf4497 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-0b1f40d1-cce4-4eee-b772-2b9c51e62fc5-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "cinder-025774fb-a5f3-4bfc-aac6-9e7772adae09-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-025774fb-a5f3-4bfc-aac6-9e7772adae09-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "cinder-quobyte-025774fb-a5f3-4bfc-aac6-9e7772adae09" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-quobyte-025774fb-a5f3-4bfc-aac6-9e7772adae09" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a05f7b1-5ad4-4d94-8bb0-93676d3b0b68]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:41 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 Nov 02 10:41:41 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:41 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09" returned: 0 in 0.528s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:41 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09 Nov 02 10:41:41 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:42 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-025774fb-a5f3-4bfc-aac6-9e7772adae09" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-quobyte-025774fb-a5f3-4bfc-aac6-9e7772adae09" released by "delete_volume" :: held 0.974s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Created reservations ['664472ca-ec69-4001-bdbc-0cd4368371a2', '6eddf30c-0962-4999-9614-b93b00410156', 'e4276ed8-a454-460e-9591-878c15b26bda', '684b9e86-030b-4b32-baf0-ffa925f85899'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:42 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:42 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:42 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.356s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Deleted volume successfully. Nov 02 10:41:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d6c58fb5-03fe-414b-9212-bc5c64da1bc6 tempest-AttachVolumeNegativeTest-315741834 None] Lock "cinder-025774fb-a5f3-4bfc-aac6-9e7772adae09-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Flow 'volume_create_manager' (9ca65ce8-a310-4f5b-abe7-eff4f34836f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997751cd-6026-4560-acb5-c460bd0483b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997751cd-6026-4560-acb5-c460bd0483b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-614192041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b0d012-744d-4586-8cdb-680ca9b67100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ac24a3fa734d3da1b225dcd4006058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:46Z,use_quota=True,user_id='79450a3dc96f4f63bae250b8d36de439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e81ea6-de55-4497-ad29-291516aceb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e81ea6-de55-4497-ad29-291516aceb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fe5c62-e83c-4fc2-873c-195a88105c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:45 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:41:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fe5c62-e83c-4fc2-873c-195a88105c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0b0d012-744d-4586-8cdb-680ca9b67100', 'volume_name': 'volume-d0b0d012-744d-4586-8cdb-680ca9b67100', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b0151a-4c7c-4f8e-8ab6-a99dc95bb09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b0151a-4c7c-4f8e-8ab6-a99dc95bb09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f2d0fd-803e-403f-9dcf-49883571abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:46 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Volume d0b0d012-744d-4586-8cdb-680ca9b67100: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0b0d012-744d-4586-8cdb-680ca9b67100', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:41:46 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Trying to clone d0b0d012-744d-4586-8cdb-680ca9b67100 from image 6256c21e-7619-488e-bde7-257c3f79e20b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:41:46 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:41:46 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:41:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acfeb48-feb3-482c-aa34-985a486a4f54]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:47 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD Nov 02 10:41:47 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:47 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:47 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b is fetched for user 79450a3dc96f4f63bae250b8d36de439. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:41:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee294f7a-59fb-4314-9c5b-ae5c398629e1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:47 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD Nov 02 10:41:47 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:48 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-614192041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b0d012-744d-4586-8cdb-680ca9b67100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ac24a3fa734d3da1b225dcd4006058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:46Z,use_quota=True,user_id='79450a3dc96f4f63bae250b8d36de439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Creating volume d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:48 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 1073741824 Nov 02 10:41:48 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:48 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 1073741824" returned: 0 in 0.870s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:49 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 Nov 02 10:41:49 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:49 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100" returned: 0 in 0.396s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Attempting download of 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume d0b0d012-744d-4586-8cdb-680ca9b67100. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a7b11d-7d20-4a69-94e5-f956b7832d84]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:49 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk Nov 02 10:41:49 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:50 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk" returned: 0 in 0.525s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:50 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk Nov 02 10:41:50 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:50 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk" returned: 1 in 0.576s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_n_ip_rwk' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:41:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ab6f7-a576-4025-8ac0-9faa24493910]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:50 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD Nov 02 10:41:50 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:51 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:51 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] 6256c21e-7619-488e-bde7-257c3f79e20b was qcow2, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:41:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:51 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 Nov 02 10:41:51 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:53 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100" returned: 0 in 2.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_ciwspm4sdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:41:53 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Converted 112.00 MB image at 46.95 MB/s Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:53 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 1G Nov 02 10:41:53 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:53 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 1G" returned: 0 in 0.398s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Downloaded image 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume d0b0d012-744d-4586-8cdb-680ca9b67100 successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b for user 79450a3dc96f4f63bae250b8d36de439 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Marking volume d0b0d012-744d-4586-8cdb-680ca9b67100 as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Copying metadata from image 6256c21e-7619-488e-bde7-257c3f79e20b to d0b0d012-744d-4586-8cdb-680ca9b67100. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Creating volume glance metadata for volume d0b0d012-744d-4586-8cdb-680ca9b67100 backed by image 6256c21e-7619-488e-bde7-257c3f79e20b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f2d0fd-803e-403f-9dcf-49883571abea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b0d012-744d-4586-8cdb-680ca9b67100', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b1a0f2-6bb1-4bf2-98cc-b06fd1801bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:53 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Volume volume-d0b0d012-744d-4586-8cdb-680ca9b67100 (d0b0d012-744d-4586-8cdb-680ca9b67100): created successfully Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b1a0f2-6bb1-4bf2-98cc-b06fd1801bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Flow 'volume_create_manager' (9ca65ce8-a310-4f5b-abe7-eff4f34836f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fdb60a6e-e166-4fd3-9574-4ecac60bc9c6 tempest-VolumesExtendTest-804910652 None] Created volume successfully. Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Flow 'volume_create_manager' (9213e246-772f-450f-86fd-9741d5074459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272017f3-6094-423c-ac65-d894ddbd09b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272017f3-6094-423c-ac65-d894ddbd09b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-387680851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c824a8a-7ccb-441c-aeda-539a8f7b763d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055f6b468f57454c9a22e535910a2011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:54Z,use_quota=True,user_id='dacebf28f4ed48d7ae9323fa7e5cd7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898c858a-01fc-48dd-a69c-135054e42666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898c858a-01fc-48dd-a69c-135054e42666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09837966-957a-411f-8850-51bd18d7317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09837966-957a-411f-8850-51bd18d7317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c824a8a-7ccb-441c-aeda-539a8f7b763d', 'volume_name': 'volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26a05fa-2202-4048-bd77-3037b9c51e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26a05fa-2202-4048-bd77-3037b9c51e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f030fdc0-6661-4788-94c3-29db510288b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:54 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Volume 1c824a8a-7ccb-441c-aeda-539a8f7b763d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d', 'volume_size': 1} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-387680851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c824a8a-7ccb-441c-aeda-539a8f7b763d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055f6b468f57454c9a22e535910a2011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:54Z,use_quota=True,user_id='dacebf28f4ed48d7ae9323fa7e5cd7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Creating volume 1c824a8a-7ccb-441c-aeda-539a8f7b763d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:54 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:54 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d 1073741824 Nov 02 10:41:54 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:54 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d 1073741824" returned: 0 in 0.493s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:54 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d Nov 02 10:41:54 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:55 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d" returned: 0 in 0.254s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.413s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f030fdc0-6661-4788-94c3-29db510288b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c566d6c4-fed8-47c0-8968-f87202d7d760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d198b418-10e0-4a76-9db6-05ce6274429b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:55 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Volume volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d (1c824a8a-7ccb-441c-aeda-539a8f7b763d): created successfully Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c566d6c4-fed8-47c0-8968-f87202d7d760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Flow 'volume_create_manager' (9213e246-772f-450f-86fd-9741d5074459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-d4737122-cba6-4ec0-9de0-9ad0a9d5f311 req-dc90b5e9-d2d3-4a80-9527-72c8d5285c72 tempest-VolumesGetTestJSON-451364151 None] Created volume successfully. Nov 02 10:41:55 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 Nov 02 10:41:55 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:55 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 2G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 2G" returned: 0 in 0.142s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.614s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Acquiring lock "cinder-1c824a8a-7ccb-441c-aeda-539a8f7b763d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Lock "cinder-1c824a8a-7ccb-441c-aeda-539a8f7b763d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7b85b8c1-c9e8-4e54-9e17-770710bc398a tempest-VolumesExtendTest-804910652 None] Extend volume completed successfully. Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Acquiring lock "cinder-quobyte-1c824a8a-7ccb-441c-aeda-539a8f7b763d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Lock "cinder-quobyte-1c824a8a-7ccb-441c-aeda-539a8f7b763d" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c19b758-3361-408d-bd7c-e630cda7fa43]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:56 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d Nov 02 10:41:56 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:56 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d" returned: 0 in 0.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:56 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d Nov 02 10:41:56 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:56 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1c824a8a-7ccb-441c-aeda-539a8f7b763d" returned: 0 in 0.316s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Lock "cinder-quobyte-1c824a8a-7ccb-441c-aeda-539a8f7b763d" released by "delete_volume" :: held 0.799s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG cinder.quota [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Created reservations ['2f9523c7-997d-42f6-bd03-a979c635aef9', 'de3a4644-87a8-4584-a442-3d568f882f9e', '3a4cfece-6077-4e9c-bde0-42b25ab59dc7', '691cc870-24ec-4567-bd72-efc8d695c3da'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:56 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:56 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:57 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.434s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG cinder.manager [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Deleted volume successfully. Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-811be282-6a20-490c-bcf2-6f4c5e5bad07 req-4e2bbd14-28d7-4703-824b-3d2552bfb84e tempest-VolumesGetTestJSON-451364151 None] Lock "cinder-1c824a8a-7ccb-441c-aeda-539a8f7b763d-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-d0b0d012-744d-4586-8cdb-680ca9b67100-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Lock "cinder-d0b0d012-744d-4586-8cdb-680ca9b67100-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-quobyte-d0b0d012-744d-4586-8cdb-680ca9b67100" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-d0b0d012-744d-4586-8cdb-680ca9b67100" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf85b3-53f4-4c5c-9ce3-9b5e68a9e9c8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:58 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 Nov 02 10:41:58 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:58 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100" returned: 0 in 0.410s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:58 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100 Nov 02 10:41:58 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:58 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d0b0d012-744d-4586-8cdb-680ca9b67100" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-d0b0d012-744d-4586-8cdb-680ca9b67100" released by "delete_volume" :: held 0.755s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Created reservations ['af2971f9-6b30-4e57-b1cc-e7ab31b4fa53', 'bc1213b0-4187-42ab-bf74-6a76d0e5ef86', '28168734-cde3-4c66-a225-7567983cb9d3', '6dd20032-59a3-4abd-9772-80d9e9a1564e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:58 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:41:58 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Flow 'volume_create_manager' (23919d46-ed83-44c7-8f43-2ace0b17cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817e7bd4-b1f6-4876-8b95-7e90742d6d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817e7bd4-b1f6-4876-8b95-7e90742d6d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1741439388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a379aa-3951-4759-b59c-9e679fe73ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f330e34cf7ee43bea5f2d500be0d4c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:59Z,use_quota=True,user_id='44f467ac0aa245e3a292edd47bc38c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d469c5e-7a6f-45ca-923b-38f0bdb73ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d469c5e-7a6f-45ca-923b-38f0bdb73ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1d0e87-7bd1-4941-ae59-b45a5657dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1d0e87-7bd1-4941-ae59-b45a5657dbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a379aa-3951-4759-b59c-9e679fe73ec6', 'volume_name': 'volume-67a379aa-3951-4759-b59c-9e679fe73ec6', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc37f2dd-0ad0-4b7d-ad7c-8881753d70a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc37f2dd-0ad0-4b7d-ad7c-8881753d70a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fae429-f7fb-4e57-af2b-916398fc9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:58 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Volume 67a379aa-3951-4759-b59c-9e679fe73ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a379aa-3951-4759-b59c-9e679fe73ec6', 'volume_size': 1} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1741439388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a379aa-3951-4759-b59c-9e679fe73ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f330e34cf7ee43bea5f2d500be0d4c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:59Z,use_quota=True,user_id='44f467ac0aa245e3a292edd47bc38c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Creating volume 67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:58 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:41:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:59 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 1073741824 Nov 02 10:41:59 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:59 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.314s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Deleted volume successfully. Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b22170f8-9620-48d0-b62b-cdc32d973b8f tempest-VolumesExtendTest-804910652 None] Lock "cinder-d0b0d012-744d-4586-8cdb-680ca9b67100-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:59 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Flow 'volume_create_manager' (af8288cf-3f5c-4215-b347-43a2be2f868f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786fcbed-6305-4798-a949-bd9a9a6706a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 1073741824" returned: 0 in 0.664s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786fcbed-6305-4798-a949-bd9a9a6706a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-546982572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40715d72-e2c7-48f3-9581-16c7cdab7668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ac24a3fa734d3da1b225dcd4006058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:00Z,use_quota=True,user_id='79450a3dc96f4f63bae250b8d36de439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37647bb2-4fe5-44e1-bcfc-b76b3731b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37647bb2-4fe5-44e1-bcfc-b76b3731b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562bfa56-f5f2-44f9-bfe0-06dc85b46bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562bfa56-f5f2-44f9-bfe0-06dc85b46bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40715d72-e2c7-48f3-9581-16c7cdab7668', 'volume_name': 'volume-40715d72-e2c7-48f3-9581-16c7cdab7668', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8471b714-78bc-472c-b9ff-b0c34ebd6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8471b714-78bc-472c-b9ff-b0c34ebd6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f63e6b-5f42-446f-982d-295e9bf647b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:59 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Volume 40715d72-e2c7-48f3-9581-16c7cdab7668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40715d72-e2c7-48f3-9581-16c7cdab7668', 'volume_size': 1} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:59 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 Nov 02 10:41:59 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:00 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6" returned: 0 in 0.323s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-546982572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40715d72-e2c7-48f3-9581-16c7cdab7668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ac24a3fa734d3da1b225dcd4006058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:00Z,use_quota=True,user_id='79450a3dc96f4f63bae250b8d36de439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Creating volume 40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:00 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:00 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 1073741824 Nov 02 10:42:00 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fae429-f7fb-4e57-af2b-916398fc9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a379aa-3951-4759-b59c-9e679fe73ec6', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d292815-5124-4642-a324-d68eb2efe041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:00 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Volume volume-67a379aa-3951-4759-b59c-9e679fe73ec6 (67a379aa-3951-4759-b59c-9e679fe73ec6): created successfully Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d292815-5124-4642-a324-d68eb2efe041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Flow 'volume_create_manager' (23919d46-ed83-44c7-8f43-2ace0b17cc36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-54d1c45a-89ef-4c91-b984-a0861d2333f8 tempest-SnapshotMetadataTestJSON-220173619 None] Created volume successfully. Nov 02 10:42:00 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 1073741824" returned: 0 in 0.690s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:00 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 Nov 02 10:42:00 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:01 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668" returned: 0 in 0.476s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Creating offline snapshot fddc0605-926f-4286-9de1-2c2a16e249d5 of volume 67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f63e6b-5f42-446f-982d-295e9bf647b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40715d72-e2c7-48f3-9581-16c7cdab7668', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bd37f9-2bd1-4814-b597-de0b8c12eebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[964cda16-4d89-4f51-8682-b49c3a31efeb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Volume volume-40715d72-e2c7-48f3-9581-16c7cdab7668 (40715d72-e2c7-48f3-9581-16c7cdab7668): created successfully Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bd37f9-2bd1-4814-b597-de0b8c12eebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Flow 'volume_create_manager' (af8288cf-3f5c-4215-b347-43a2be2f868f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-875ee573-43f3-497e-9472-c090bdce715d tempest-VolumesExtendTest-804910652 None] Created volume successfully. Nov 02 10:42:01 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 Nov 02 10:42:01 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:01 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6" returned: 0 in 0.554s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:01 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 1G Nov 02 10:42:01 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:02 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 1G" returned: 0 in 0.531s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a379aa-3951-4759-b59c-9e679fe73ec6 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:02 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a379aa-3951-4759-b59c-9e679fe73ec6 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 Nov 02 10:42:02 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:02 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a379aa-3951-4759-b59c-9e679fe73ec6 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5" returned: 0 in 0.344s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:02 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 is being set with open permissions: ugo+rw Nov 02 10:42:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:02 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 Nov 02 10:42:02 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:03 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:03 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info Nov 02 10:42:03 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:03 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:03 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info is being set with open permissions: ugo+rw Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:03 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info Nov 02 10:42:03 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:03 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.info" returned: 0 in 0.265s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.669s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Creating offline snapshot e5503ab6-02aa-41dc-a9ba-40329dcdfe5d of volume 40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:42:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f414210a-c8eb-4822-a04d-f9ba43a6453a tempest-SnapshotMetadataTestJSON-220173619 None] Create snapshot completed successfully Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2a6ac1-bf69-45e5-adb3-5f52077c55bb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Acquiring lock "cinder-a7271e00-c7cf-4046-91d2-4c6dd672631c-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "cinder-a7271e00-c7cf-4046-91d2-4c6dd672631c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:03 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 Nov 02 10:42:03 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Acquiring lock "cinder-quobyte-a7271e00-c7cf-4046-91d2-4c6dd672631c" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "cinder-quobyte-a7271e00-c7cf-4046-91d2-4c6dd672631c" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca26abc-8bf4-4455-8933-9969b4e1de72]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:04 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c Nov 02 10:42:04 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:04 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668" returned: 0 in 0.411s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:04 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d 1G Nov 02 10:42:04 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:04 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c" returned: 0 in 0.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:04 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c Nov 02 10:42:04 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:04 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d 1G" returned: 0 in 0.483s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40715d72-e2c7-48f3-9581-16c7cdab7668 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:04 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40715d72-e2c7-48f3-9581-16c7cdab7668 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d Nov 02 10:42:04 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:04 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a7271e00-c7cf-4046-91d2-4c6dd672631c" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "cinder-quobyte-a7271e00-c7cf-4046-91d2-4c6dd672631c" released by "delete_volume" :: held 0.803s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Created reservations ['a62f2bd8-572f-431c-b94c-bce4ace709e2', '0bfc7126-a948-4169-9680-09c8f002ee68', 'adcf0299-6540-4e3e-885b-a16165a9bfe5', 'b6275414-87b6-4815-84e0-702e03abc109'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=103,cinder:DELETE=10,cinder:SELECT=80,cinder:INSERT=32 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:04 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:04 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:05 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40715d72-e2c7-48f3-9581-16c7cdab7668 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" returned: 0 in 0.459s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:05 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d is being set with open permissions: ugo+rw Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:05 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d Nov 02 10:42:05 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:05 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Deleted volume successfully. Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7b938ad6-5670-4969-8cc7-800b7bb159b6 tempest-AttachVolumeShelveTestJSON-1581696150 None] Lock "cinder-a7271e00-c7cf-4046-91d2-4c6dd672631c-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:05 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=107,cinder:INSERT=40,cinder:UPDATE=113,cinder:DELETE=8 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:05 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info Nov 02 10:42:05 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "cinder-fddc0605-926f-4286-9de1-2c2a16e249d5-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-fddc0605-926f-4286-9de1-2c2a16e249d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "cinder-quobyte-67a379aa-3951-4759-b59c-9e679fe73ec6" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-quobyte-67a379aa-3951-4759-b59c-9e679fe73ec6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "cinder-quobyte-fddc0605-926f-4286-9de1-2c2a16e249d5" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-quobyte-fddc0605-926f-4286-9de1-2c2a16e249d5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Deleting offline snapshot fddc0605-926f-4286-9de1-2c2a16e249d5 of volume 67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:42:05 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] snapshot_file for this snap is: volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info" returned: 0 in 0.341s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:05 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info is being set with open permissions: ugo+rw Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc39b32-97b5-41db-8c55-cfc06dd3a55f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:05 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info Nov 02 10:42:05 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:06 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 Nov 02 10:42:06 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:06 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.info" returned: 0 in 0.373s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c2d017d9-f7d7-4044-9043-c65e5d7767c0 tempest-VolumesExtendTest-804910652 None] Create snapshot completed successfully Nov 02 10:42:06 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5" returned: 0 in 0.508s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67a379aa-3951-4759-b59c-9e679fe73ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4abcba-c8fe-473e-b68f-75fb17d942b2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:06 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 Nov 02 10:42:06 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:06 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6" returned: 0 in 0.427s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:06 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 Nov 02 10:42:06 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:07 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5" returned: 0 in 0.442s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:07 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5 Nov 02 10:42:07 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6507a93e-5494-44cc-92b6-76fdba288117]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:07 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 Nov 02 10:42:07 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:07 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6.fddc0605-926f-4286-9de1-2c2a16e249d5" returned: 0 in 0.417s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-quobyte-fddc0605-926f-4286-9de1-2c2a16e249d5" released by "_delete_snapshot" :: held 1.957s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-quobyte-67a379aa-3951-4759-b59c-9e679fe73ec6" released by "delete_snapshot" :: held 1.989s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:07 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Created reservations ['66ef5cf2-526b-48e0-b549-32800026d2f5', 'cc3877bc-7518-466e-a831-42bf8ad6aa6e', 'e9907a82-da70-482e-9796-ced4a12f31d5', 'aedfa112-ece3-4d2b-81e4-413780c0cd84'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Delete snapshot completed successfully. Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-085e8414-9939-4a5d-b2f8-684543042853 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-fddc0605-926f-4286-9de1-2c2a16e249d5-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:08 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668" returned: 0 in 0.486s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d 2G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d 2G" returned: 0 in 0.171s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.710s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8b83197c-2e9e-4ab9-8d20-70611ee01193 tempest-VolumesExtendTest-804910652 None] Extend volume completed successfully. Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-e5503ab6-02aa-41dc-a9ba-40329dcdfe5d-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Lock "cinder-e5503ab6-02aa-41dc-a9ba-40329dcdfe5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-quobyte-40715d72-e2c7-48f3-9581-16c7cdab7668" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-40715d72-e2c7-48f3-9581-16c7cdab7668" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-quobyte-e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Deleting offline snapshot e5503ab6-02aa-41dc-a9ba-40329dcdfe5d of volume 40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] snapshot_file for this snap is: volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042b869-fd95-4939-85de-d2f321cbd151]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:08 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d Nov 02 10:42:08 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "cinder-67a379aa-3951-4759-b59c-9e679fe73ec6-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-67a379aa-3951-4759-b59c-9e679fe73ec6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "cinder-quobyte-67a379aa-3951-4759-b59c-9e679fe73ec6" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-quobyte-67a379aa-3951-4759-b59c-9e679fe73ec6" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[148051af-993c-4d27-837d-d013d8d502c8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:09 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" returned: 0 in 0.419s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40715d72-e2c7-48f3-9581-16c7cdab7668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb271d0-0936-4832-83f5-cee41013e32c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:09 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 Nov 02 10:42:09 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:09 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 Nov 02 10:42:09 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:09 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6" returned: 0 in 0.512s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:09 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6 Nov 02 10:42:09 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:09 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668" returned: 0 in 0.573s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:09 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d Nov 02 10:42:09 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:10 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-67a379aa-3951-4759-b59c-9e679fe73ec6" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-quobyte-67a379aa-3951-4759-b59c-9e679fe73ec6" released by "delete_volume" :: held 0.909s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Created reservations ['bfeb7245-0f9c-47fd-9163-c65e1ec8222c', 'b240da57-566d-49a3-bc75-bfe1922625ef', 'a1aac86a-0b6d-413d-9c73-969dbb80213b', 'c3fdb226-58c3-49c8-807f-7bb8046fd958'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:10 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:10 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:10 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" returned: 0 in 0.536s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:10 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d Nov 02 10:42:10 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:10 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.411s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:10 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Deleted volume successfully. Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d5ac26c7-34d0-41e7-8651-e3adfccf6540 tempest-SnapshotMetadataTestJSON-220173619 None] Lock "cinder-67a379aa-3951-4759-b59c-9e679fe73ec6-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:10 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668.e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" returned: 0 in 0.419s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-e5503ab6-02aa-41dc-a9ba-40329dcdfe5d" released by "_delete_snapshot" :: held 2.096s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-40715d72-e2c7-48f3-9581-16c7cdab7668" released by "delete_snapshot" :: held 2.125s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Created reservations ['1f1698d8-8565-46c7-b2b8-b189b0ffe70a', 'fecc9f5e-2d76-406e-8010-3f71bb07fead', '6684588c-cb4f-4d83-9007-7dfb28cc0b6a', '83532a54-b818-46e4-ae12-46d6cd8ce1dc'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Delete snapshot completed successfully. Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-285f123f-14bc-4882-b854-ca5d521bfe00 tempest-VolumesExtendTest-804910652 None] Lock "cinder-e5503ab6-02aa-41dc-a9ba-40329dcdfe5d-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Flow 'volume_create_manager' (6a4a9e59-b892-4100-aa2d-358810c5bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274eb1a4-e1bc-426d-a7c1-bd2776596370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274eb1a4-e1bc-426d-a7c1-bd2776596370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1909999066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7d157a-497c-4901-b3e0-3201954ca0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7c5a2a63c94b20856ea5589f41ee0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:12Z,use_quota=True,user_id='7b4f895b69f34ecba9ab1bdd5cee5366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae1d8c2-1cc4-434d-98e7-1b13e039231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae1d8c2-1cc4-434d-98e7-1b13e039231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97cc0da-a2ab-4e04-93c1-1630fccebdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97cc0da-a2ab-4e04-93c1-1630fccebdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7d157a-497c-4901-b3e0-3201954ca0d2', 'volume_name': 'volume-fd7d157a-497c-4901-b3e0-3201954ca0d2', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4c0160-9588-45f7-9a4e-64f6e82e8740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4c0160-9588-45f7-9a4e-64f6e82e8740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6e11e0-4096-4292-a57b-d85402529394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:11 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Volume fd7d157a-497c-4901-b3e0-3201954ca0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7d157a-497c-4901-b3e0-3201954ca0d2', 'volume_size': 1} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1909999066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7d157a-497c-4901-b3e0-3201954ca0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7c5a2a63c94b20856ea5589f41ee0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:12Z,use_quota=True,user_id='7b4f895b69f34ecba9ab1bdd5cee5366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Creating volume fd7d157a-497c-4901-b3e0-3201954ca0d2 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:11 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:11 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 1073741824 Nov 02 10:42:11 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-40715d72-e2c7-48f3-9581-16c7cdab7668-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Lock "cinder-40715d72-e2c7-48f3-9581-16c7cdab7668-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Acquiring lock "cinder-quobyte-40715d72-e2c7-48f3-9581-16c7cdab7668" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-40715d72-e2c7-48f3-9581-16c7cdab7668" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38246b9-2894-47e4-bbee-7873d730691f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:12 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 1073741824" returned: 0 in 0.619s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:12 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 Nov 02 10:42:12 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:12 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 Nov 02 10:42:12 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:12 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2" returned: 0 in 0.322s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6e11e0-4096-4292-a57b-d85402529394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7d157a-497c-4901-b3e0-3201954ca0d2', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d750ad-f09f-4408-ab1d-c3f84938c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:12 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Volume volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 (fd7d157a-497c-4901-b3e0-3201954ca0d2): created successfully Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d750ad-f09f-4408-ab1d-c3f84938c515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:12 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Flow 'volume_create_manager' (6a4a9e59-b892-4100-aa2d-358810c5bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668" returned: 0 in 0.543s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9fffae4f-fe22-42ba-9afc-73894a978f72 tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Created volume successfully. Nov 02 10:42:12 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668 Nov 02 10:42:12 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:13 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-40715d72-e2c7-48f3-9581-16c7cdab7668" returned: 0 in 0.315s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Lock "cinder-quobyte-40715d72-e2c7-48f3-9581-16c7cdab7668" released by "delete_volume" :: held 0.943s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Created reservations ['d5224b90-6b59-445d-a0d2-aa3bc0445362', 'e44377c7-a264-4a55-9aa7-6ffdc7d8a7ce', '8d08cc76-7633-471e-90ce-7f22033842af', '2f542748-fde4-4179-8244-cac5eeb93831'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:13 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:13 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:13 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Deleted volume successfully. Nov 02 10:42:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-219df2b1-5f60-4fe0-862f-20c89d460e6e tempest-VolumesExtendTest-804910652 None] Lock "cinder-40715d72-e2c7-48f3-9581-16c7cdab7668-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Acquiring lock "cinder-fd7d157a-497c-4901-b3e0-3201954ca0d2-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "cinder-fd7d157a-497c-4901-b3e0-3201954ca0d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Acquiring lock "cinder-quobyte-fd7d157a-497c-4901-b3e0-3201954ca0d2" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "cinder-quobyte-fd7d157a-497c-4901-b3e0-3201954ca0d2" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:15 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ae155-0e44-45db-a1af-93abd3d9779d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:15 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 Nov 02 10:42:15 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:16 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2" returned: 0 in 0.462s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:16 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2 Nov 02 10:42:16 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:16 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fd7d157a-497c-4901-b3e0-3201954ca0d2" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "cinder-quobyte-fd7d157a-497c-4901-b3e0-3201954ca0d2" released by "delete_volume" :: held 0.839s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Created reservations ['c0d72440-7b56-4a01-bc80-8898e1ff30d9', 'd7b2708d-ab57-4bbe-8358-b967f404604f', 'e550d9ee-d79d-40c4-8dfb-a24d8f47dd75', '75f9e9f7-ddcb-4f31-b88d-5f65a7705b9c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:16 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:16 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-629a51bd-29ae-40a1-9157-3b5b5b94bf53 tempest-GroupsTest-1262974167 None] Group tempest-Group1-939741929: creating Nov 02 10:42:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-629a51bd-29ae-40a1-9157-3b5b5b94bf53 tempest-GroupsTest-1262974167 None] Group tempest-Group1-939741929: created successfully Nov 02 10:42:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-629a51bd-29ae-40a1-9157-3b5b5b94bf53 tempest-GroupsTest-1262974167 None] Create group completed successfully. Nov 02 10:42:17 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.410s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:17 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Deleted volume successfully. Nov 02 10:42:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-87c46507-aacb-416c-9137-555ae20861ec tempest-VolumeQuotasNegativeTestJSON-1020722345 None] Lock "cinder-fd7d157a-497c-4901-b3e0-3201954ca0d2-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2b643dc6-fddc-4398-973b-88360e2a2d61 tempest-GroupsTest-1262974167 None] Group tempest-Group2-2082755233: creating Nov 02 10:42:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2b643dc6-fddc-4398-973b-88360e2a2d61 tempest-GroupsTest-1262974167 None] Group tempest-Group2-2082755233: created successfully Nov 02 10:42:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2b643dc6-fddc-4398-973b-88360e2a2d61 tempest-GroupsTest-1262974167 None] Create group completed successfully. Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Flow 'volume_create_manager' (6de0ad2b-9bd6-4d53-a931-3751a7f86f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3691a3-bb18-476c-a068-d1add6ad2991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3691a3-bb18-476c-a068-d1add6ad2991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1164876112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1b439d8-acde-4ebd-9cc2-00c2c8660c13,host='devstack@QuobyteHD#QuobyteHD',id=3c7b8d1d-735b-4661-a833-c47ecd25b264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bad79cc2a1f4578a671f53545ed10b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:20Z,use_quota=True,user_id='5e2c0851880d4603928ea5a8fed3a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d17a4fd8-7d7c-40d5-a0a1-41c070b91ce2),volume_type_id=d17a4fd8-7d7c-40d5-a0a1-41c070b91ce2)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10197a91-0a5b-4729-8318-08f7d7cdf2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10197a91-0a5b-4729-8318-08f7d7cdf2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bbdd81-30c6-4451-8e16-040b19e82cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bbdd81-30c6-4451-8e16-040b19e82cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7b8d1d-735b-4661-a833-c47ecd25b264', 'volume_name': 'volume-3c7b8d1d-735b-4661-a833-c47ecd25b264', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f9fad5-5baf-4038-9c37-f66925952ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f9fad5-5baf-4038-9c37-f66925952ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b33a904-335b-401b-a096-64e4d4884ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:20 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Volume 3c7b8d1d-735b-4661-a833-c47ecd25b264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7b8d1d-735b-4661-a833-c47ecd25b264', 'volume_size': 1} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1b439d8-acde-4ebd-9cc2-00c2c8660c13,created_at=2026-11-02T09:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1164876112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1b439d8-acde-4ebd-9cc2-00c2c8660c13,host='devstack@QuobyteHD#QuobyteHD',id=3c7b8d1d-735b-4661-a833-c47ecd25b264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bad79cc2a1f4578a671f53545ed10b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:20Z,use_quota=True,user_id='5e2c0851880d4603928ea5a8fed3a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d17a4fd8-7d7c-40d5-a0a1-41c070b91ce2),volume_type_id=d17a4fd8-7d7c-40d5-a0a1-41c070b91ce2)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Creating volume 3c7b8d1d-735b-4661-a833-c47ecd25b264 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:20 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:20 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 1073741824 Nov 02 10:42:20 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:20 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 1073741824" returned: 0 in 0.678s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:20 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 Nov 02 10:42:20 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:21 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b33a904-335b-401b-a096-64e4d4884ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7b8d1d-735b-4661-a833-c47ecd25b264', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d8d385-bda8-47a2-ae0f-f9c98a809e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:21 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Volume volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 (3c7b8d1d-735b-4661-a833-c47ecd25b264): created successfully Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d8d385-bda8-47a2-ae0f-f9c98a809e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Flow 'volume_create_manager' (6de0ad2b-9bd6-4d53-a931-3751a7f86f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d4a58931-1f86-4917-b036-aa3d21243470 tempest-GroupsTest-1262974167 None] Created volume successfully. Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Flow 'volume_create_manager' (0c583e39-ece4-40dd-aa97-44b1d9257c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebce295a-b50a-4a8a-99c8-dc604a3f1f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebce295a-b50a-4a8a-99c8-dc604a3f1f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-752793617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bff1f8f-bf5f-40b1-a492-ab1c39f0e268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dfe6b2afac4aed8f8ce5d24ae58818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:22Z,use_quota=True,user_id='3d23a13288694b61a480c58397dbcb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5128c2-ca19-427e-9d86-2a25cab168cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5128c2-ca19-427e-9d86-2a25cab168cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028f9fff-e46a-4190-bb55-28d0aace0b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028f9fff-e46a-4190-bb55-28d0aace0b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bff1f8f-bf5f-40b1-a492-ab1c39f0e268', 'volume_name': 'volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e6f131-d211-421c-9cb0-f2d4cceeeead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e6f131-d211-421c-9cb0-f2d4cceeeead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faeb23a-867a-4338-9df8-8c874515f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Volume 8bff1f8f-bf5f-40b1-a492-ab1c39f0e268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268', 'volume_size': 1} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-752793617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bff1f8f-bf5f-40b1-a492-ab1c39f0e268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dfe6b2afac4aed8f8ce5d24ae58818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:22Z,use_quota=True,user_id='3d23a13288694b61a480c58397dbcb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Creating volume 8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:22 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:22 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 1073741824 Nov 02 10:42:22 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:22 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:22 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:22 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 1073741824" returned: 0 in 0.550s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:22 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:22 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:22 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.316s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:42:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:42:23 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faeb23a-867a-4338-9df8-8c874515f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d92e0e-076f-41c5-b2bf-5037cdd6d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:23 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Volume volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 (8bff1f8f-bf5f-40b1-a492-ab1c39f0e268): created successfully Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d92e0e-076f-41c5-b2bf-5037cdd6d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Flow 'volume_create_manager' (0c583e39-ece4-40dd-aa97-44b1d9257c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7c494abb-cafe-4c36-9c0d-2f696a21bb4d tempest-VolumesDeleteCascade-2066684281 None] Created volume successfully. Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Acquiring lock "cinder-quobyte-3c7b8d1d-735b-4661-a833-c47ecd25b264" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Lock "cinder-quobyte-3c7b8d1d-735b-4661-a833-c47ecd25b264" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8914ea67-4501-4de9-a417-3019c0df8e3c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:23 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 Nov 02 10:42:23 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:24 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264" returned: 0 in 0.457s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:24 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264 Nov 02 10:42:24 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Flow 'volume_create_manager' (07c951ae-ee8d-4248-bfb1-9d336543ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befd1113-65bf-4403-be4a-b031a18af208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befd1113-65bf-4403-be4a-b031a18af208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1472862531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa6b861-99ab-4fc7-b93b-2b368e3b4f61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b5ba9e36854b1db739ebbe3493f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:24Z,use_quota=True,user_id='6300a90bec4a4df1a060ce6d112b227c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af670ba-4464-4d51-9967-8f12e12b4c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af670ba-4464-4d51-9967-8f12e12b4c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39afd5e9-1b21-435d-9eab-587d2d3853ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39afd5e9-1b21-435d-9eab-587d2d3853ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa6b861-99ab-4fc7-b93b-2b368e3b4f61', 'volume_name': 'volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b19809b-57fc-40b7-8054-8a3a55fa3c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b19809b-57fc-40b7-8054-8a3a55fa3c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca629ab9-d0fc-4861-b9cc-027336392e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Volume 3aa6b861-99ab-4fc7-b93b-2b368e3b4f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61', 'volume_size': 1} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1472862531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa6b861-99ab-4fc7-b93b-2b368e3b4f61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b5ba9e36854b1db739ebbe3493f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:24Z,use_quota=True,user_id='6300a90bec4a4df1a060ce6d112b227c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Creating volume 3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:24 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:24 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 1073741824 Nov 02 10:42:24 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:24 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c7b8d1d-735b-4661-a833-c47ecd25b264" returned: 0 in 0.418s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Lock "cinder-quobyte-3c7b8d1d-735b-4661-a833-c47ecd25b264" released by "delete_volume" :: held 0.951s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Created reservations ['53f3c6cd-5303-4559-b7f0-e59fbe168cdc'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:24 devstack cinder-volume[86926]: WARNING cinder.quota [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1847246819 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1847246819, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:42:24 devstack cinder-volume[86926]: WARNING cinder.quota [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1847246819 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1847246819, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Created reservations ['873398f1-fd05-426f-b573-4938b5d5a9fe', '23a0e4d8-823a-4584-8859-799cff35767a', 'c82231a2-2776-40c0-9d83-effdc8c4022c', 'c38664d5-350a-405d-b665-c42cefbd56b5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:24 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:24 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:24 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 1073741824" returned: 0 in 0.643s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:25 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 Nov 02 10:42:25 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:25 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.305s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9492a144-8b11-4fe1-999e-c6bd577d4aa3 tempest-GroupsTest-1262974167 None] Delete group completed successfully. Nov 02 10:42:25 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.773s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca629ab9-d0fc-4861-b9cc-027336392e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c431356a-87aa-4004-a4ed-99f4c0ec6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Creating offline snapshot 0f240f44-3edc-411f-9f8c-83d0f6b968d3 of volume 8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:42:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Volume volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 (3aa6b861-99ab-4fc7-b93b-2b368e3b4f61): created successfully Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c431356a-87aa-4004-a4ed-99f4c0ec6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Flow 'volume_create_manager' (07c951ae-ee8d-4248-bfb1-9d336543ab84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590b14b-6162-4a26-b472-d36fe4150d0e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dc306f7c-b059-46e6-a8af-06d9bc882cb8 tempest-VolumesListTestJSON-349421243 None] Created volume successfully. Nov 02 10:42:25 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:25 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:25 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.404s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:25 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 1G Nov 02 10:42:25 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:25 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Created reservations ['6b68e17b-b243-4b0c-9109-d9c0994bd775'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:26 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:26 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:26 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 1G" returned: 0 in 0.554s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:26 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.320s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7aad11c2-4947-4763-a5e0-b77725932aad tempest-GroupsTest-1262974167 None] Delete group completed successfully. Nov 02 10:42:26 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:26 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:26 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:26 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 is being set with open permissions: ugo+rw Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:26 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:26 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Flow 'volume_create_manager' (a7dc3563-fba8-45e5-beda-450b4f4e05a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1fe165-7dbe-4c7e-8585-a768653eb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1fe165-7dbe-4c7e-8585-a768653eb755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-766463145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adab6be3-6105-4b1f-ac39-6f96a13c41a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b5ba9e36854b1db739ebbe3493f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:27Z,use_quota=True,user_id='6300a90bec4a4df1a060ce6d112b227c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0481e4bb-08f1-41d3-ab7b-71c9efa101d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0481e4bb-08f1-41d3-ab7b-71c9efa101d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd89f1f4-113b-46f7-96f7-931717614242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd89f1f4-113b-46f7-96f7-931717614242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adab6be3-6105-4b1f-ac39-6f96a13c41a7', 'volume_name': 'volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e3ce7e-d09e-4893-9c38-a94be3a96015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e3ce7e-d09e-4893-9c38-a94be3a96015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859e0a6a-09ff-465a-8af6-04b81269196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Volume adab6be3-6105-4b1f-ac39-6f96a13c41a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7', 'volume_size': 1} Nov 02 10:42:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:27 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.296s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:27 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info Nov 02 10:42:27 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:27 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info" returned: 0 in 0.296s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:27 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info is being set with open permissions: ugo+rw Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:27 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info Nov 02 10:42:27 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-253d9a85-73d1-4a08-84a6-54bd51503afd tempest-GroupsTest-1262974167 None] Group tempest-GroupsTest-Group-98243215: creating Nov 02 10:42:27 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.info" returned: 0 in 0.305s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-766463145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adab6be3-6105-4b1f-ac39-6f96a13c41a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b5ba9e36854b1db739ebbe3493f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:27Z,use_quota=True,user_id='6300a90bec4a4df1a060ce6d112b227c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Creating volume adab6be3-6105-4b1f-ac39-6f96a13c41a7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:27 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:27 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 1073741824 Nov 02 10:42:27 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-253d9a85-73d1-4a08-84a6-54bd51503afd tempest-GroupsTest-1262974167 None] Group tempest-GroupsTest-Group-98243215: created successfully Nov 02 10:42:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1e050018-0428-46a7-a7b8-bc3ca8cfdfef tempest-VolumesDeleteCascade-2066684281 None] Create snapshot completed successfully Nov 02 10:42:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-253d9a85-73d1-4a08-84a6-54bd51503afd tempest-GroupsTest-1262974167 None] Create group completed successfully. Nov 02 10:42:28 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 1073741824" returned: 0 in 0.504s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:28 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 Nov 02 10:42:28 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:28 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7" returned: 0 in 0.257s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859e0a6a-09ff-465a-8af6-04b81269196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce50801-82e3-47a4-80c7-cc6db7a64e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:28 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Volume volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 (adab6be3-6105-4b1f-ac39-6f96a13c41a7): created successfully Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce50801-82e3-47a4-80c7-cc6db7a64e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Flow 'volume_create_manager' (a7dc3563-fba8-45e5-beda-450b4f4e05a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d4770352-13a6-4d80-8132-c15238a41c04 tempest-VolumesListTestJSON-349421243 None] Created volume successfully. Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Creating offline snapshot c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a of volume 8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea9616-666e-45fb-bfcc-af12200b29c3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:29 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:29 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Flow 'volume_create_manager' (2987b471-47cd-4b88-b69d-f4cf9120a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cbd550-f602-477d-aa8b-22e2ca789967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cbd550-f602-477d-aa8b-22e2ca789967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-22639178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=507d2291-8216-4f54-9ef0-c33d3becda8f,host='devstack@QuobyteHD#QuobyteHD',id=cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bad79cc2a1f4578a671f53545ed10b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:29Z,use_quota=True,user_id='5e2c0851880d4603928ea5a8fed3a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd155945-2fc0-41ef-b666-3708c284bc3f),volume_type_id=fd155945-2fc0-41ef-b666-3708c284bc3f)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262db4e3-d6a4-447e-bdab-f3bdb96e607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262db4e3-d6a4-447e-bdab-f3bdb96e607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5230f841-25f9-41f4-8ad8-e729f8bf1c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5230f841-25f9-41f4-8ad8-e729f8bf1c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5', 'volume_name': 'volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48eb68c9-ab66-44ed-bcc8-8ed550e5c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48eb68c9-ab66-44ed-bcc8-8ed550e5c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73873881-8e1e-45de-bccf-df017a3199bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Volume cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5', 'volume_size': 1} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:29 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Flow 'volume_create_manager' (81f31266-f3aa-4b5b-9a4d-161114bf5b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4067eb-f60b-4357-ab34-f9ba4b1cf82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.671s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4067eb-f60b-4357-ab34-f9ba4b1cf82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-166314843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81d1e50-db2e-4c0e-9f0a-cd580a3caa06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b5ba9e36854b1db739ebbe3493f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:30Z,use_quota=True,user_id='6300a90bec4a4df1a060ce6d112b227c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a 1G Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826496df-0607-4209-89fe-5219c038e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826496df-0607-4209-89fe-5219c038e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbb0354-bf80-49e7-a2c2-722402c04875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbb0354-bf80-49e7-a2c2-722402c04875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81d1e50-db2e-4c0e-9f0a-cd580a3caa06', 'volume_name': 'volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10cc7e9-e8f9-404e-82eb-f0d090826df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10cc7e9-e8f9-404e-82eb-f0d090826df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f91c0b5-ec54-4ba3-95b5-63d81d84f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:29 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Volume d81d1e50-db2e-4c0e-9f0a-cd580a3caa06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06', 'volume_size': 1} Nov 02 10:42:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:30 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a 1G" returned: 0 in 0.458s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:30 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a Nov 02 10:42:30 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:30 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" returned: 0 in 0.312s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:30 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a is being set with open permissions: ugo+rw Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:30 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a Nov 02 10:42:30 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:30 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=507d2291-8216-4f54-9ef0-c33d3becda8f,created_at=2026-11-02T09:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-22639178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=507d2291-8216-4f54-9ef0-c33d3becda8f,host='devstack@QuobyteHD#QuobyteHD',id=cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bad79cc2a1f4578a671f53545ed10b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:29Z,use_quota=True,user_id='5e2c0851880d4603928ea5a8fed3a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd155945-2fc0-41ef-b666-3708c284bc3f),volume_type_id=fd155945-2fc0-41ef-b666-3708c284bc3f)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Creating volume cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:30 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:30 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 1073741824 Nov 02 10:42:30 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d314450d-28ce-4767-a1a0-38d22a904c69 tempest-VolumesDeleteCascade-2066684281 None] Create snapshot completed successfully Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Performing cascade delete. {{(pid=86926) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-0f240f44-3edc-411f-9f8c-83d0f6b968d3-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-0f240f44-3edc-411f-9f8c-83d0f6b968d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-0f240f44-3edc-411f-9f8c-83d0f6b968d3" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-0f240f44-3edc-411f-9f8c-83d0f6b968d3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Deleting offline snapshot 0f240f44-3edc-411f-9f8c-83d0f6b968d3 of volume 8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:42:31 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] snapshot_file for this snap is: volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 1073741824" returned: 0 in 0.573s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[928c34e5-d787-452f-b908-8c68f44fc9ad]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:31 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 Nov 02 10:42:31 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:31 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:31 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:31 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-166314843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81d1e50-db2e-4c0e-9f0a-cd580a3caa06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b5ba9e36854b1db739ebbe3493f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:30Z,use_quota=True,user_id='6300a90bec4a4df1a060ce6d112b227c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Creating volume d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:31 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:31 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 1073741824 Nov 02 10:42:31 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:31 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73873881-8e1e-45de-bccf-df017a3199bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f96d6dd-fe91-44aa-ae8e-1672a9ad95ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:31 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Volume volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 (cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5): created successfully Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f96d6dd-fe91-44aa-ae8e-1672a9ad95ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Flow 'volume_create_manager' (2987b471-47cd-4b88-b69d-f4cf9120a459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8187fd12-8cdd-4bd5-afa8-681627bfdfea]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:31 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1440a059-faa0-47c6-9c74-9c48cee233a2 tempest-GroupsTest-1262974167 None] Created volume successfully. Nov 02 10:42:31 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:31 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:32 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 1073741824" returned: 0 in 0.525s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:32 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.444s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[813fc6e1-7824-4455-871b-44ae420f122a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:32 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 Nov 02 10:42:32 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:32 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a Nov 02 10:42:32 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:32 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f91c0b5-ec54-4ba3-95b5-63d81d84f534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920bc037-2df5-4837-bbc4-3b1111ebe4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:32 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Volume volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 (d81d1e50-db2e-4c0e-9f0a-cd580a3caa06): created successfully Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920bc037-2df5-4837-bbc4-3b1111ebe4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Flow 'volume_create_manager' (81f31266-f3aa-4b5b-9a4d-161114bf5b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-525e03ea-7b21-4497-b196-35bee8c9845a tempest-VolumesListTestJSON-349421243 None] Created volume successfully. Nov 02 10:42:32 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" returned: 0 in 0.473s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a224f4cc-356d-48b9-82ae-061176d0124c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:32 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:32 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:33 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.394s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2fef3-d2ce-4bc5-9ca4-75a6c653021c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:33 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:33 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:33 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.455s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:33 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:33 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Flow 'volume_create_manager' (3f3a2b1e-7b27-4bce-8337-8894d19d6667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad48995-faf8-4e1d-b953-5ba42b493d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad48995-faf8-4e1d-b953-5ba42b493d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105464588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=507d2291-8216-4f54-9ef0-c33d3becda8f,host='devstack@QuobyteHD#QuobyteHD',id=1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bad79cc2a1f4578a671f53545ed10b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:34Z,use_quota=True,user_id='5e2c0851880d4603928ea5a8fed3a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd155945-2fc0-41ef-b666-3708c284bc3f),volume_type_id=fd155945-2fc0-41ef-b666-3708c284bc3f)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa43705-56cb-4a49-8b22-2d6cbd749eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa43705-56cb-4a49-8b22-2d6cbd749eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55047e2d-dc17-4c61-9a9f-a98a54596609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55047e2d-dc17-4c61-9a9f-a98a54596609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5', 'volume_name': 'volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509dd8d1-7899-4c1b-badc-48a2ac63b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509dd8d1-7899-4c1b-badc-48a2ac63b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e971d2-3ad7-40c6-b71a-2630a0864ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:33 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Volume 1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5', 'volume_size': 1} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=507d2291-8216-4f54-9ef0-c33d3becda8f,created_at=2026-11-02T09:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105464588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=507d2291-8216-4f54-9ef0-c33d3becda8f,host='devstack@QuobyteHD#QuobyteHD',id=1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bad79cc2a1f4578a671f53545ed10b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:34Z,use_quota=True,user_id='5e2c0851880d4603928ea5a8fed3a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd155945-2fc0-41ef-b666-3708c284bc3f),volume_type_id=fd155945-2fc0-41ef-b666-3708c284bc3f)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Creating volume 1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:33 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:33 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 1073741824 Nov 02 10:42:33 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:34 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.506s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:34 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3 Nov 02 10:42:34 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:34 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 1073741824" returned: 0 in 0.641s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:34 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.0f240f44-3edc-411f-9f8c-83d0f6b968d3" returned: 0 in 0.317s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a -F qcow2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:34 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a -F qcow2 Nov 02 10:42:34 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:34 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 Nov 02 10:42:34 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:34 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a -F qcow2" returned: 0 in 0.409s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:34 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5" returned: 0 in 0.386s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-0f240f44-3edc-411f-9f8c-83d0f6b968d3" released by "_delete_snapshot" :: held 3.664s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e971d2-3ad7-40c6-b71a-2630a0864ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b9070e-a542-49b2-b6c9-70273ae92ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" released by "delete_snapshot" :: held 3.720s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:35 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Volume volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 (1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5): created successfully Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b9070e-a542-49b2-b6c9-70273ae92ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Flow 'volume_create_manager' (3f3a2b1e-7b27-4bce-8337-8894d19d6667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4b4aea92-61a0-406c-a1ba-dbffff496708 tempest-GroupsTest-1262974167 None] Created volume successfully. Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Created reservations ['8b9d16ac-758c-4e87-8428-317afb2a1f9f', 'a57d6479-7eb9-4ba7-942d-fff022bdc85c', '97ed7fde-77ba-4162-9f6d-b6b9e592f7ce', 'd0e0c883-aeef-41d3-8f85-cd81954cbbc7'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Delete snapshot completed successfully. Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-0f240f44-3edc-411f-9f8c-83d0f6b968d3-delete_snapshot" released by "delete_snapshot" :: held 3.937s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Deleting offline snapshot c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a of volume 8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] snapshot_file for this snap is: volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d0228-314c-4150-a7ad-ef54fa96cb42]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:35 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a Nov 02 10:42:35 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:35 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" returned: 0 in 0.657s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f9b6b2-b77b-4746-bd04-29f58ef48484]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:36 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:36 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d78c62a0-63f3-4d4e-9f68-37b326ffa7c2 tempest-GroupsTest-1262974167 None] Update group completed successfully. Nov 02 10:42:36 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.456s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:36 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a Nov 02 10:42:36 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "cinder-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "cinder-quobyte-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-quobyte-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f2789-5003-4dc5-8115-f76bce02a2d4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:36 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" returned: 0 in 0.443s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:36 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a Nov 02 10:42:36 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:36 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 Nov 02 10:42:36 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:37 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268.c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" returned: 0 in 0.269s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a" released by "_delete_snapshot" :: held 1.976s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:37 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" released by "delete_snapshot" :: held 2.014s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06" returned: 0 in 0.443s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:37 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06 Nov 02 10:42:37 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Created reservations ['1eb1c3a9-663b-49b0-a191-aa297669eb09', '79f627e2-5e5d-4b2b-b9fd-c58d300f1d67', '042b84c6-458d-4012-9a07-37d28e3cb291', 'f74f5862-d504-467a-882d-35c806c59a92'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Delete snapshot completed successfully. Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-c0b1cec2-9e3e-4e85-beb7-5e79d9d0135a-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Snapshots deleted, issuing volume delete {{(pid=86926) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac59fe75-d108-4241-b6c1-cec9d9a07992]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:37 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06" returned: 0 in 0.331s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-quobyte-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06" released by "delete_volume" :: held 0.824s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:37 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:37 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Created reservations ['7308819e-68cb-4ce8-a03e-95fcfaeab823', 'f5195391-641b-4522-a41a-826891281a2e', '825206e3-291a-4c9a-80c0-a7ec2afc96a0', '472a4e6c-5130-4e7b-9375-1789d50ab420'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:37 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:37 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0e0211de-6e6d-4fd1-a7f9-2dc60365155b tempest-GroupsTest-1262974167 None] Update group completed successfully. Nov 02 10:42:38 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.468s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "cinder-adab6be3-6105-4b1f-ac39-6f96a13c41a7-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:38 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268 Nov 02 10:42:38 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-adab6be3-6105-4b1f-ac39-6f96a13c41a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "cinder-quobyte-adab6be3-6105-4b1f-ac39-6f96a13c41a7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-quobyte-adab6be3-6105-4b1f-ac39-6f96a13c41a7" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a879b4e-3d4f-4cda-a159-b6531aaca244]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:38 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.352s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Deleted volume successfully. Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c42bc00-ebe5-43f7-9825-400dc32e4bf0 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-d81d1e50-db2e-4c0e-9f0a-cd580a3caa06-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:38 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 Nov 02 10:42:38 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:38 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268" released by "delete_volume" :: held 0.885s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Created reservations ['2b60645d-16b7-4d89-9dd9-556e84ea7ff0', '8ee8d289-1745-4931-96f9-ab4185fb7ef9', 'b54bad2d-7e40-4e2a-be12-0f52a1f3cb24', 'c9220b27-daa5-4c3f-ad82-fcc266a7e19e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:38 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:38 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:38 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7" returned: 0 in 0.419s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:38 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7 Nov 02 10:42:38 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:38 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.308s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Deleted volume successfully. Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8f46d488-c8e9-476c-9518-47ca4bc8edcf tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-8bff1f8f-bf5f-40b1-a492-ab1c39f0e268-delete_volume" released by "delete_volume" :: held 7.740s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:38 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-adab6be3-6105-4b1f-ac39-6f96a13c41a7" returned: 0 in 0.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-quobyte-adab6be3-6105-4b1f-ac39-6f96a13c41a7" released by "delete_volume" :: held 0.799s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Created reservations ['3267fe2e-e0ab-4b16-912c-bfcf10dba640', '59dadf5d-ed90-4f98-9429-2a234c6a472d', 'f5861681-3123-422c-9143-2545fca1f04e', '27a57549-cd7a-435c-a2d7-7644b62a1e51'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:39 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:39 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:39 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.373s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Deleted volume successfully. Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-685f7b98-4e59-4d53-93e0-4505233e7ef2 tempest-VolumesListTestJSON-349421243 None] Lock "cinder-adab6be3-6105-4b1f-ac39-6f96a13c41a7-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Acquiring lock "cinder-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Lock "cinder-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Acquiring lock "cinder-quobyte-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Lock "cinder-quobyte-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[13deab32-efb7-440a-a33d-25b2e0626b46]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Acquiring lock "cinder-quobyte-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Lock "cinder-quobyte-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ddfbf3-5013-49ee-bcb9-1ab96c298c22]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:40 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 Nov 02 10:42:40 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Flow 'volume_create_manager' (e224e9c9-69d3-402e-9cc4-bce547078c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d60d1-5485-4d10-87d1-e9dcadafe7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d60d1-5485-4d10-87d1-e9dcadafe7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1178373070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653f52a4-1af7-47c2-ae40-d8e0d6ad56a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dfe6b2afac4aed8f8ce5d24ae58818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:40Z,use_quota=True,user_id='3d23a13288694b61a480c58397dbcb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4a1ae7-c80e-4752-94f8-5fd4ea54a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4a1ae7-c80e-4752-94f8-5fd4ea54a355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15260acf-cf12-43e5-98f9-ff65b203291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15260acf-cf12-43e5-98f9-ff65b203291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653f52a4-1af7-47c2-ae40-d8e0d6ad56a3', 'volume_name': 'volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80af8ca-6e76-4629-b597-bce0cc1790ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80af8ca-6e76-4629-b597-bce0cc1790ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1c4570-19d4-4098-bc6a-5804cea30b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Volume 653f52a4-1af7-47c2-ae40-d8e0d6ad56a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3', 'volume_size': 1} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1178373070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653f52a4-1af7-47c2-ae40-d8e0d6ad56a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dfe6b2afac4aed8f8ce5d24ae58818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:40Z,use_quota=True,user_id='3d23a13288694b61a480c58397dbcb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Creating volume 653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:40 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 Nov 02 10:42:40 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:40 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:40 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 1073741824 Nov 02 10:42:40 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:40 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61" returned: 0 in 0.560s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:40 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61 Nov 02 10:42:40 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:40 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5" returned: 0 in 0.505s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:40 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5 Nov 02 10:42:40 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:40 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 1073741824" returned: 0 in 0.601s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:40 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:40 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Lock "cinder-quobyte-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61" released by "delete_volume" :: held 1.027s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Lock "cinder-quobyte-1cb5c98d-7f55-41dc-ab4f-4fa12c6425c5" released by "delete_volume" :: held 0.904s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Acquiring lock "cinder-quobyte-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:40 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 Nov 02 10:42:40 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Lock "cinder-quobyte-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae542a15-76c4-4cb6-b416-1292058d638f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Created reservations ['ad478fb8-9662-4427-affa-eaef74b153d3', 'a1684ef2-0ce9-49e0-8766-f167401868e4', '85de92ee-b292-4b72-a4a6-5980dde1fdd5', '50c1fe2d-c640-4207-86d1-d53d9170e893'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:41 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 Nov 02 10:42:41 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:41 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" returned: 0 in 0.290s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1c4570-19d4-4098-bc6a-5804cea30b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:41 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:41 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6119c5f-0792-43a5-b43c-9eb35b680741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Volume volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 (653f52a4-1af7-47c2-ae40-d8e0d6ad56a3): created successfully Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6119c5f-0792-43a5-b43c-9eb35b680741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Flow 'volume_create_manager' (e224e9c9-69d3-402e-9cc4-bce547078c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1872033f-e680-43c6-a26c-1409fac016c7 tempest-VolumesDeleteCascade-2066684281 None] Created volume successfully. Nov 02 10:42:41 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.298s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:41 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5" returned: 0 in 0.475s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Deleted volume successfully. Nov 02 10:42:41 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5 Nov 02 10:42:41 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6d1d1a6d-a3f9-46f6-b654-4052aff62e3a tempest-VolumesListTestJSON-349421243 None] Lock "cinder-3aa6b861-99ab-4fc7-b93b-2b368e3b4f61-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:41 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5" returned: 0 in 0.298s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Lock "cinder-quobyte-cf66c1eb-d0b1-49f5-88fd-a49a2a2a3ba5" released by "delete_volume" :: held 0.848s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Created reservations ['ffe5be21-7961-4bd1-ba2a-5d59e49e64ce'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:41 devstack cinder-volume[86926]: WARNING cinder.quota [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2068472383 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2068472383, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:42:41 devstack cinder-volume[86926]: WARNING cinder.quota [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2068472383 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2068472383, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:42:41 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Created reservations ['79b2ec88-366b-4b8e-9c8d-0d97665debb3', '08e93137-9c03-42e9-a1a9-9ef2442d524b', 'bfd0247c-b085-4316-91a0-c0a4f0ad801d', 'dc9e40ee-fcdb-4655-89a5-e699892ab920'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Created reservations ['d5001ebd-d257-4a70-a2e6-1213e2e97d5c', '0538bb85-b661-427c-993c-9fe504d3b499', '63cb9e71-2a42-4274-be01-e5dc0e54ea47', '3ec2f62e-0f38-4983-8063-d71e4fcdd8c5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:42 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:42:42 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Creating offline snapshot b44432a5-5379-4e79-a20e-78931952a26a of volume 653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[de314ea7-9a51-459b-96cb-e5849fbd5ea6]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:42 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.498s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:42 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7e1dbb3d-b007-4251-996f-2f7f1ffb3336 tempest-GroupsTest-1262974167 None] Delete group completed successfully. Nov 02 10:42:42 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 Nov 02 10:42:42 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:43 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" returned: 0 in 0.466s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:43 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a 1G Nov 02 10:42:43 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:43 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a 1G" returned: 0 in 0.503s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:43 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a Nov 02 10:42:43 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:44 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a" returned: 0 in 0.456s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:44 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a is being set with open permissions: ugo+rw Nov 02 10:42:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:44 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a Nov 02 10:42:44 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:44 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a" returned: 0 in 0.299s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:44 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info Nov 02 10:42:44 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:44 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:44 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info is being set with open permissions: ugo+rw Nov 02 10:42:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:44 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info Nov 02 10:42:44 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:45 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.info" returned: 0 in 0.354s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b152f88f-5c0a-47f1-98ff-d657aabbef5e tempest-VolumesDeleteCascade-2066684281 None] Create snapshot completed successfully Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Flow 'volume_create_manager' (6e5c45d5-2dff-4a0c-924c-1ba2ac14e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2f91e0-f9bb-44b8-a43d-cf021c3a91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2f91e0-f9bb-44b8-a43d-cf021c3a91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-133996810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711165cc-6a37-4520-9775-bde6e73b8b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dfe6b2afac4aed8f8ce5d24ae58818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b44432a5-5379-4e79-a20e-78931952a26a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:47Z,use_quota=True,user_id='3d23a13288694b61a480c58397dbcb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a0580b-94f1-48ea-a1d1-d5692455c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a0580b-94f1-48ea-a1d1-d5692455c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b409beae-9c87-4a65-9de6-473223696eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b409beae-9c87-4a65-9de6-473223696eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '711165cc-6a37-4520-9775-bde6e73b8b7a', 'volume_name': 'volume-711165cc-6a37-4520-9775-bde6e73b8b7a', 'volume_size': 1, 'snapshot_id': 'b44432a5-5379-4e79-a20e-78931952a26a'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317ce9b4-da79-4f06-8559-c6ab4d21483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317ce9b4-da79-4f06-8559-c6ab4d21483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f56530-4a7b-422d-80b1-c57a043ea015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Volume 711165cc-6a37-4520-9775-bde6e73b8b7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-711165cc-6a37-4520-9775-bde6e73b8b7a', 'volume_size': 1, 'snapshot_id': 'b44432a5-5379-4e79-a20e-78931952a26a'} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-b44432a5-5379-4e79-a20e-78931952a26a-711165cc-6a37-4520-9775-bde6e73b8b7a" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-b44432a5-5379-4e79-a20e-78931952a26a-711165cc-6a37-4520-9775-bde6e73b8b7a" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Creating volume 711165cc-6a37-4520-9775-bde6e73b8b7a from snapshot b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-711165cc-6a37-4520-9775-bde6e73b8b7a" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-711165cc-6a37-4520-9775-bde6e73b8b7a" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] snapshot: b44432a5-5379-4e79-a20e-78931952a26a, volume: 711165cc-6a37-4520-9775-bde6e73b8b7a, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c0bab-e48b-4456-a3ef-6c48abfb1113]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:46 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a Nov 02 10:42:46 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:47 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a" returned: 0 in 0.462s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[278d07c7-6b53-49c2-b567-f4c749d2f145]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:47 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 Nov 02 10:42:47 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Flow 'volume_create_manager' (4402969d-4119-4a47-a787-cfb688e3e9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d45f6c-0f6f-4a0f-bbf4-21663f5cc282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d45f6c-0f6f-4a0f-bbf4-21663f5cc282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1884517820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47867cb4-3650-406b-9390-cf8ea9bc4b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209c85107b124be285daa8c444dfcb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:48Z,use_quota=True,user_id='c123fba6d10c4b6d9ef34b4f3e39a3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc2df73-4167-47fc-90ec-6d0c418f9b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc2df73-4167-47fc-90ec-6d0c418f9b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6256d975-58a8-4c62-b06e-310408a8548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6256d975-58a8-4c62-b06e-310408a8548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47867cb4-3650-406b-9390-cf8ea9bc4b1c', 'volume_name': 'volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8756212d-9817-46ca-95af-54d1a9a35621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8756212d-9817-46ca-95af-54d1a9a35621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d09a88f-213e-497e-ba54-d82bb0cd3b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Volume 47867cb4-3650-406b-9390-cf8ea9bc4b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c', 'volume_size': 1} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:47 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" returned: 0 in 0.572s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:42:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:47 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a Nov 02 10:42:47 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:56 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a" returned: 0 in 8.585s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:42:56 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Converted 1024.00 MB image at 119.26 MB/s Nov 02 10:42:56 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a is being set with open permissions: ugo+rw Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:56 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a Nov 02 10:42:56 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=158,cinder:DELETE=12,cinder:SELECT=105,cinder:INSERT=37 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:42:56 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a" returned: 0 in 0.346s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-711165cc-6a37-4520-9775-bde6e73b8b7a" released by "_copy_volume_from_snapshot" :: held 10.097s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-b44432a5-5379-4e79-a20e-78931952a26a-711165cc-6a37-4520-9775-bde6e73b8b7a" released by "_create_volume_from_snapshot" :: held 10.188s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.208s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.202s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1884517820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47867cb4-3650-406b-9390-cf8ea9bc4b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209c85107b124be285daa8c444dfcb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:48Z,use_quota=True,user_id='c123fba6d10c4b6d9ef34b4f3e39a3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Creating volume 47867cb4-3650-406b-9390-cf8ea9bc4b1c {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:56 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:42:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:57 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c 1073741824 Nov 02 10:42:57 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f56530-4a7b-422d-80b1-c57a043ea015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711165cc-6a37-4520-9775-bde6e73b8b7a', 'volume_size': 1, 'snapshot_id': 'b44432a5-5379-4e79-a20e-78931952a26a'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b564cc89-1f2f-4b35-b15d-4077e1fc4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Volume volume-711165cc-6a37-4520-9775-bde6e73b8b7a (711165cc-6a37-4520-9775-bde6e73b8b7a): created successfully Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b564cc89-1f2f-4b35-b15d-4077e1fc4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Flow 'volume_create_manager' (6e5c45d5-2dff-4a0c-924c-1ba2ac14e90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-90ef79cd-e2a8-43df-88c2-f3657a289fbb tempest-VolumesDeleteCascade-2066684281 None] Created volume successfully. Nov 02 10:42:57 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c 1073741824" returned: 0 in 0.554s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:57 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c Nov 02 10:42:57 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:57 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d09a88f-213e-497e-ba54-d82bb0cd3b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc615fc-3ed5-444f-849c-7782beeb41b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Volume volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c (47867cb4-3650-406b-9390-cf8ea9bc4b1c): created successfully Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc615fc-3ed5-444f-849c-7782beeb41b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Flow 'volume_create_manager' (4402969d-4119-4a47-a787-cfb688e3e9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-64051c68-2af7-45ee-a171-67b212e725a1 tempest-VolumesNegativeTest-1729845929 None] Created volume successfully. Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Performing cascade delete. {{(pid=86926) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-b44432a5-5379-4e79-a20e-78931952a26a-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-b44432a5-5379-4e79-a20e-78931952a26a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-b44432a5-5379-4e79-a20e-78931952a26a" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-b44432a5-5379-4e79-a20e-78931952a26a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Deleting offline snapshot b44432a5-5379-4e79-a20e-78931952a26a of volume 653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] snapshot_file for this snap is: volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc866c-b725-4f11-a78e-582d28f2e1a7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:58 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a Nov 02 10:42:58 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:58 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a" returned: 0 in 0.503s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:42:59 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ee1ee4-9e46-44e5-bf03-198f98bed8c9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:59 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 Nov 02 10:42:59 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:59 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" returned: 0 in 0.812s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:59 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a Nov 02 10:42:59 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:00 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a" returned: 0 in 0.527s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:00 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a Nov 02 10:43:00 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:00 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3.b44432a5-5379-4e79-a20e-78931952a26a" returned: 0 in 0.351s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-b44432a5-5379-4e79-a20e-78931952a26a" released by "_delete_snapshot" :: held 2.381s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" released by "delete_snapshot" :: held 2.408s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Created reservations ['7e32ca69-2f1f-48d1-98d4-cf247e5cf0fb', 'c72cad7a-676e-41c6-9cfa-5cc4cc10e652', '4f4d9450-1cb9-415b-b50e-c80d5e042481', '2642d8d9-43a8-4cce-a6c9-a84a391e57d1'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Delete snapshot completed successfully. Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-b44432a5-5379-4e79-a20e-78931952a26a-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Snapshots deleted, issuing volume delete {{(pid=86926) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c332df11-3348-46fc-8e5b-e5230a92d8c2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:01 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 Nov 02 10:43:01 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:01 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" returned: 0 in 0.555s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:01 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3 Nov 02 10:43:01 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:01 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" returned: 0 in 0.375s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3" released by "delete_volume" :: held 1.071s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Created reservations ['88135740-428a-44b5-8e3d-61ca7467285d', 'bc58ebdc-5693-404a-b0f0-e05638adcfc7', '543532a7-cbf9-42a3-8af1-eb8e7b3b5d86', '823c0129-d338-49c7-b88d-7ec9b34be46a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:02 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:02 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:02 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.508s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-711165cc-6a37-4520-9775-bde6e73b8b7a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Deleted volume successfully. Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-711165cc-6a37-4520-9775-bde6e73b8b7a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9baf219b-b3b1-4724-9959-288ce0b44075 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-653f52a4-1af7-47c2-ae40-d8e0d6ad56a3-delete_volume" released by "delete_volume" :: held 4.717s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "cinder-quobyte-711165cc-6a37-4520-9775-bde6e73b8b7a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-711165cc-6a37-4520-9775-bde6e73b8b7a" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d923e1e6-a0ec-4e44-bab7-f73534327604]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:03 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a Nov 02 10:43:03 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:03 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a" returned: 0 in 0.715s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:03 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a Nov 02 10:43:03 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:04 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-711165cc-6a37-4520-9775-bde6e73b8b7a" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-quobyte-711165cc-6a37-4520-9775-bde6e73b8b7a" released by "delete_volume" :: held 1.212s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Created reservations ['2bb2486d-26cf-4cdf-8a68-28a127f64272', '18b3371f-ac31-4fe3-bbe7-092041e334de', 'c05417b0-c431-4135-8afb-950ede206831', '18a4a10e-4212-4821-ae50-4cb9179a7775'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:04 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:04 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:04 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Deleted volume successfully. Nov 02 10:43:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9b3da10b-4b8a-4cbe-92cb-bd214a658d27 tempest-VolumesDeleteCascade-2066684281 None] Lock "cinder-711165cc-6a37-4520-9775-bde6e73b8b7a-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=166,cinder:INSERT=41,cinder:UPDATE=170,cinder:DELETE=11 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (e5ec7b7a-8706-4cb6-9e3d-bcd93357f25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bb62cf-eaf9-4675-ade5-4eebc7f73714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bb62cf-eaf9-4675-ade5-4eebc7f73714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-913151217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae86254c-5d3b-4a34-a754-3e531b719d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:14Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4206a08a-c04f-4120-8ebb-267139758fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4206a08a-c04f-4120-8ebb-267139758fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e888d11-c553-481f-b542-ea9994a1a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e888d11-c553-481f-b542-ea9994a1a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae86254c-5d3b-4a34-a754-3e531b719d57', 'volume_name': 'volume-ae86254c-5d3b-4a34-a754-3e531b719d57', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00be019f-3e5d-431e-83a9-3b3670dabc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00be019f-3e5d-431e-83a9-3b3670dabc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a8b59-9844-4df2-bec6-7b178bff0459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:14 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Volume ae86254c-5d3b-4a34-a754-3e531b719d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae86254c-5d3b-4a34-a754-3e531b719d57', 'volume_size': 1} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-913151217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae86254c-5d3b-4a34-a754-3e531b719d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:14Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Creating volume ae86254c-5d3b-4a34-a754-3e531b719d57 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:14 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:14 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 1073741824 Nov 02 10:43:14 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:15 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 1073741824" returned: 0 in 1.074s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:15 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 Nov 02 10:43:15 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:15 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a8b59-9844-4df2-bec6-7b178bff0459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae86254c-5d3b-4a34-a754-3e531b719d57', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58c6944-5820-4fa4-a994-6b8dc30e441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:15 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Volume volume-ae86254c-5d3b-4a34-a754-3e531b719d57 (ae86254c-5d3b-4a34-a754-3e531b719d57): created successfully Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58c6944-5820-4fa4-a994-6b8dc30e441f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (e5ec7b7a-8706-4cb6-9e3d-bcd93357f25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c2f70d9a-0281-4694-ac14-8d06676d0ed3 tempest-VolumesActionsTest-1736867463 None] Created volume successfully. Nov 02 10:43:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-255bc800-70e0-4e65-976e-2cb740016f7e tempest-VolumesActionsTest-1736867463 None] Acquiring lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57" by "attach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-255bc800-70e0-4e65-976e-2cb740016f7e tempest-VolumesActionsTest-1736867463 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57" acquired by "attach_volume" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-255bc800-70e0-4e65-976e-2cb740016f7e tempest-VolumesActionsTest-1736867463 None] Attaching volume ae86254c-5d3b-4a34-a754-3e531b719d57 to instance 667d2917-b361-4419-9639-ffb55963324a at mountpoint /dev/vdb on host None. Nov 02 10:43:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-255bc800-70e0-4e65-976e-2cb740016f7e tempest-VolumesActionsTest-1736867463 None] Attach volume completed successfully. Nov 02 10:43:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-255bc800-70e0-4e65-976e-2cb740016f7e tempest-VolumesActionsTest-1736867463 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57" released by "attach_volume" :: held 0.186s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:16 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Flow 'volume_create_manager' (cae22929-403c-4bdf-b959-a6e121751906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e074c1-8a6a-4820-ac77-22b2848e5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e074c1-8a6a-4820-ac77-22b2848e5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-833069872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a6e417-50aa-446c-aacb-e0a3a70d0555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b0539f189e4c27be67847bf1cda211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:17Z,use_quota=True,user_id='d125ed0f7879472882bd650ce96eb241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a44d53-2b91-4f4f-8a1e-a6b8eb29a185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a44d53-2b91-4f4f-8a1e-a6b8eb29a185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c55a038-7ac5-474f-935d-1dd3d1c7e01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c55a038-7ac5-474f-935d-1dd3d1c7e01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a6e417-50aa-446c-aacb-e0a3a70d0555', 'volume_name': 'volume-54a6e417-50aa-446c-aacb-e0a3a70d0555', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de383720-93e4-4af0-bd0c-53a07e718a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de383720-93e4-4af0-bd0c-53a07e718a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c16850b-57c1-4be8-8e91-6b6726807433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:17 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Volume 54a6e417-50aa-446c-aacb-e0a3a70d0555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a6e417-50aa-446c-aacb-e0a3a70d0555', 'volume_size': 1} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-833069872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a6e417-50aa-446c-aacb-e0a3a70d0555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b0539f189e4c27be67847bf1cda211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:17Z,use_quota=True,user_id='d125ed0f7879472882bd650ce96eb241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Creating volume 54a6e417-50aa-446c-aacb-e0a3a70d0555 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:17 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:17 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 1073741824 Nov 02 10:43:17 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:17 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 1073741824" returned: 0 in 0.562s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:17 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 Nov 02 10:43:17 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-df0bfcc5-d4b9-4a12-97dd-664e2b1160d7 tempest-VolumesActionsTest-1837380288 None] Terminate volume connection completed successfully. Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df0bfcc5-d4b9-4a12-97dd-664e2b1160d7 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-detach_volume" by "detach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df0bfcc5-d4b9-4a12-97dd-664e2b1160d7 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-df0bfcc5-d4b9-4a12-97dd-664e2b1160d7 tempest-VolumesActionsTest-1837380288 None] Detaching volume ae86254c-5d3b-4a34-a754-3e531b719d57 from instance 667d2917-b361-4419-9639-ffb55963324a. Nov 02 10:43:18 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c16850b-57c1-4be8-8e91-6b6726807433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a6e417-50aa-446c-aacb-e0a3a70d0555', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04a8757-cc7d-43d0-b056-c4d1a371d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-df0bfcc5-d4b9-4a12-97dd-664e2b1160d7 tempest-VolumesActionsTest-1837380288 None] Detach volume completed successfully. Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-df0bfcc5-d4b9-4a12-97dd-664e2b1160d7 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:18 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Volume volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 (54a6e417-50aa-446c-aacb-e0a3a70d0555): created successfully Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04a8757-cc7d-43d0-b056-c4d1a371d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Flow 'volume_create_manager' (cae22929-403c-4bdf-b959-a6e121751906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a1a9c410-aaa6-4628-9991-0cd9540ab80e tempest-VolumesTransfersV357Test-90265854 None] Created volume successfully. Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-235b0c1a-ab16-47f9-99ea-e97c14b00a97 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-detach_volume" by "detach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-235b0c1a-ab16-47f9-99ea-e97c14b00a97 tempest-VolumesActionsTest-1736867463 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-235b0c1a-ab16-47f9-99ea-e97c14b00a97 tempest-VolumesActionsTest-1736867463 None] Volume detach called, but volume not attached. Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-235b0c1a-ab16-47f9-99ea-e97c14b00a97 tempest-VolumesActionsTest-1736867463 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "cinder-quobyte-ae86254c-5d3b-4a34-a754-3e531b719d57" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Lock "cinder-quobyte-ae86254c-5d3b-4a34-a754-3e531b719d57" acquired by "delete_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2183172-d0e3-4ff4-b700-5852e7cd265b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:19 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 Nov 02 10:43:19 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:19 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57" returned: 0 in 0.780s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:20 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57 Nov 02 10:43:20 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:20 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-eca0439f-2261-4f22-ba19-1e615935ed5b tempest-VolumesTransfersV357Test-987901493 None] Transfer volume completed successfully. Nov 02 10:43:20 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ae86254c-5d3b-4a34-a754-3e531b719d57" returned: 0 in 0.585s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Lock "cinder-quobyte-ae86254c-5d3b-4a34-a754-3e531b719d57" released by "delete_volume" :: held 1.449s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Created reservations ['89e25321-7590-4edb-94f2-0f597378353b', 'cb5ffab5-9d9e-434f-ac2a-0f9bfae43473', '844e61a4-1f73-4dad-90e9-e5651c7c65c3', '647d5245-e77b-43e5-aef6-b0cab58397a5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:20 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:20 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:21 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Deleted volume successfully. Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b7b0b27-40f3-4f4c-a269-b9a4dc891789 tempest-VolumesActionsTest-1736867463 None] Lock "cinder-ae86254c-5d3b-4a34-a754-3e531b719d57-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Acquiring lock "cinder-54a6e417-50aa-446c-aacb-e0a3a70d0555-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-54a6e417-50aa-446c-aacb-e0a3a70d0555-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Acquiring lock "cinder-quobyte-54a6e417-50aa-446c-aacb-e0a3a70d0555" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-quobyte-54a6e417-50aa-446c-aacb-e0a3a70d0555" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[df36f9ee-6119-48e7-9206-ffffda6a01b3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:22 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 Nov 02 10:43:22 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:22 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:22 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:22 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555" returned: 0 in 0.712s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:22 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555 Nov 02 10:43:22 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:22 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.430s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:43:23 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-54a6e417-50aa-446c-aacb-e0a3a70d0555" returned: 0 in 0.416s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-quobyte-54a6e417-50aa-446c-aacb-e0a3a70d0555" released by "delete_volume" :: held 1.205s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Created reservations ['d78ebeb9-919a-425c-952a-2b63e15f2fb1', '750bbb51-a118-4a00-af3e-896dd46d3f3d', 'db731d1b-79bf-4c15-b95a-66bdc48276b9', 'ba4563a5-0971-4cad-a7e5-22f6632eb0d9'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:23 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:23 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:23 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.497s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Deleted volume successfully. Nov 02 10:43:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-686d340c-7f3c-4082-b789-12ed2340cec6 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-54a6e417-50aa-446c-aacb-e0a3a70d0555-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Flow 'volume_create_manager' (f54688ce-48ba-48a5-a288-277f7b5c9539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7383d812-510f-45bb-a324-8dbdb6b76d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7383d812-510f-45bb-a324-8dbdb6b76d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1203181319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1efca21-53b9-48b1-8f3a-6e88d127ffe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b0539f189e4c27be67847bf1cda211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:25Z,use_quota=True,user_id='d125ed0f7879472882bd650ce96eb241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1e39ac-edef-48e9-b4a8-e5dcb5b09d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1e39ac-edef-48e9-b4a8-e5dcb5b09d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4822fd1-58ba-4b63-925a-9e0134928afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4822fd1-58ba-4b63-925a-9e0134928afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1efca21-53b9-48b1-8f3a-6e88d127ffe3', 'volume_name': 'volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42f5b94-819c-45bc-bf40-8b59d4e0d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42f5b94-819c-45bc-bf40-8b59d4e0d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd00c339-b7dd-4dd6-ac95-6c7b21d1048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Volume c1efca21-53b9-48b1-8f3a-6e88d127ffe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3', 'volume_size': 1} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1203181319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1efca21-53b9-48b1-8f3a-6e88d127ffe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b0539f189e4c27be67847bf1cda211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:25Z,use_quota=True,user_id='d125ed0f7879472882bd650ce96eb241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Creating volume c1efca21-53b9-48b1-8f3a-6e88d127ffe3 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:25 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:25 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 1073741824 Nov 02 10:43:25 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:25 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 1073741824" returned: 0 in 0.603s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:25 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 Nov 02 10:43:25 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (39207e7b-2176-4794-8e03-2674ad64e948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b34432-f299-4ad6-b1d2-5a63aca81d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b34432-f299-4ad6-b1d2-5a63aca81d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-714667807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32d490a-e108-490b-b266-8dfbef596360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:26Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8685fbd-e867-4023-a294-592a7049379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8685fbd-e867-4023-a294-592a7049379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0142841-c45c-4e19-9291-7110c4c483cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0142841-c45c-4e19-9291-7110c4c483cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32d490a-e108-490b-b266-8dfbef596360', 'volume_name': 'volume-d32d490a-e108-490b-b266-8dfbef596360', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a0faf8-8f66-431e-bd78-e578e38b9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a0faf8-8f66-431e-bd78-e578e38b9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410e5c1a-e93a-4cb9-adb5-e8c7f649c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Volume d32d490a-e108-490b-b266-8dfbef596360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32d490a-e108-490b-b266-8dfbef596360', 'volume_size': 1} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:25 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3" returned: 0 in 0.285s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-714667807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32d490a-e108-490b-b266-8dfbef596360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:26Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Creating volume d32d490a-e108-490b-b266-8dfbef596360 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:26 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd00c339-b7dd-4dd6-ac95-6c7b21d1048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8aa6dcd-5726-4395-a83b-198f7fa354cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:26 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 1073741824 Nov 02 10:43:26 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Volume volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 (c1efca21-53b9-48b1-8f3a-6e88d127ffe3): created successfully Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8aa6dcd-5726-4395-a83b-198f7fa354cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Flow 'volume_create_manager' (f54688ce-48ba-48a5-a288-277f7b5c9539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7ff34ab5-40fe-4511-a85f-4c71d872baf2 tempest-VolumesTransfersV357Test-90265854 None] Created volume successfully. Nov 02 10:43:26 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 1073741824" returned: 0 in 0.602s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:26 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 Nov 02 10:43:26 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:26 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360" returned: 0 in 0.323s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410e5c1a-e93a-4cb9-adb5-e8c7f649c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32d490a-e108-490b-b266-8dfbef596360', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b833cf94-dc8b-42c5-9fba-9995845fa929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:27 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Volume volume-d32d490a-e108-490b-b266-8dfbef596360 (d32d490a-e108-490b-b266-8dfbef596360): created successfully Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b833cf94-dc8b-42c5-9fba-9995845fa929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (39207e7b-2176-4794-8e03-2674ad64e948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a356dbcf-2ae8-4b75-8508-391cdf300d51 tempest-VolumesActionsTest-1736867463 None] Created volume successfully. Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Flow 'volume_create_manager' (cbccd512-2b88-4f49-8079-29a4a240e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea53104-53e0-4732-9f75-ebe2901da42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea53104-53e0-4732-9f75-ebe2901da42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1420203225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be665070-56e3-4678-ae3f-9baaa2b09aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bd666aee754cdcaa964c012df717ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:27Z,use_quota=True,user_id='da39cdfc4333431294944f4bf5d61d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e01e52f2-838e-4c20-9a99-8292c44f437b),volume_type_id=e01e52f2-838e-4c20-9a99-8292c44f437b)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8a979-e01a-4bc3-943d-c7a9bf39bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8a979-e01a-4bc3-943d-c7a9bf39bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15ef855-3eee-4568-9aa2-c2df6fa413f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15ef855-3eee-4568-9aa2-c2df6fa413f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be665070-56e3-4678-ae3f-9baaa2b09aea', 'volume_name': 'volume-be665070-56e3-4678-ae3f-9baaa2b09aea', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8f6680-84f8-43b0-98ad-d76b298ef939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8f6680-84f8-43b0-98ad-d76b298ef939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a44400-29cd-4896-ab56-b8488043a4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:27 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Volume be665070-56e3-4678-ae3f-9baaa2b09aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be665070-56e3-4678-ae3f-9baaa2b09aea', 'volume_size': 1} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1420203225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be665070-56e3-4678-ae3f-9baaa2b09aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bd666aee754cdcaa964c012df717ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:27Z,use_quota=True,user_id='da39cdfc4333431294944f4bf5d61d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e01e52f2-838e-4c20-9a99-8292c44f437b),volume_type_id=e01e52f2-838e-4c20-9a99-8292c44f437b)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Creating volume be665070-56e3-4678-ae3f-9baaa2b09aea {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:27 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:27 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea 1073741824 Nov 02 10:43:27 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Acquiring lock "cinder-47867cb4-3650-406b-9390-cf8ea9bc4b1c-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Acquiring lock "cinder-c1efca21-53b9-48b1-8f3a-6e88d127ffe3-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Lock "cinder-47867cb4-3650-406b-9390-cf8ea9bc4b1c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-c1efca21-53b9-48b1-8f3a-6e88d127ffe3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Acquiring lock "cinder-quobyte-c1efca21-53b9-48b1-8f3a-6e88d127ffe3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Acquiring lock "cinder-quobyte-47867cb4-3650-406b-9390-cf8ea9bc4b1c" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-quobyte-c1efca21-53b9-48b1-8f3a-6e88d127ffe3" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Lock "cinder-quobyte-47867cb4-3650-406b-9390-cf8ea9bc4b1c" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d64d57-a05d-4f92-bbf2-41dd5a4c2507]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e119b0-ec41-4c4f-b8b5-9cc187715c8a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:27 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 Nov 02 10:43:27 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:27 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c Nov 02 10:43:27 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:27 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea 1073741824" returned: 0 in 0.591s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:27 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea Nov 02 10:43:27 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3" returned: 0 in 0.512s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:28 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c" returned: 0 in 0.504s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:28 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3 Nov 02 10:43:28 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-d32d490a-e108-490b-b266-8dfbef596360-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:28 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c Nov 02 10:43:28 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-d32d490a-e108-490b-b266-8dfbef596360-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-quobyte-d32d490a-e108-490b-b266-8dfbef596360" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-d32d490a-e108-490b-b266-8dfbef596360" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643e503-9f07-463c-b1fa-b8da9d170bb6]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:28 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a44400-29cd-4896-ab56-b8488043a4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be665070-56e3-4678-ae3f-9baaa2b09aea', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1b5afe-a71b-45ef-8f2a-82c945719e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:28 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Volume volume-be665070-56e3-4678-ae3f-9baaa2b09aea (be665070-56e3-4678-ae3f-9baaa2b09aea): created successfully Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1b5afe-a71b-45ef-8f2a-82c945719e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Flow 'volume_create_manager' (cbccd512-2b88-4f49-8079-29a4a240e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5caf5dac-3894-49db-a406-b0c069d91e3d tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Created volume successfully. Nov 02 10:43:28 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 Nov 02 10:43:28 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47867cb4-3650-406b-9390-cf8ea9bc4b1c" returned: 0 in 0.333s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Lock "cinder-quobyte-47867cb4-3650-406b-9390-cf8ea9bc4b1c" released by "delete_volume" :: held 0.895s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:28 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c1efca21-53b9-48b1-8f3a-6e88d127ffe3" returned: 0 in 0.407s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-quobyte-c1efca21-53b9-48b1-8f3a-6e88d127ffe3" released by "delete_volume" :: held 0.977s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Created reservations ['1ab6f796-c30e-4edc-9e94-bd7cd89644e8', 'd0f08367-9b44-4cdc-88ce-659a3e363211', '84f6eabc-5125-416a-b4bb-7f72af25f0f8', 'e47cef46-4a71-43fa-89f2-69365685f601'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Created reservations ['e037a52b-240c-4742-a2a4-fc5b01f49132', '1c084c11-6e82-4155-a5e6-e647b9a849df', '4beb06f0-6dbd-4e4e-870a-c06019813f90', 'a6858055-fd43-45b8-84ee-384abe6fad6e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:28 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360" returned: 0 in 0.423s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:28 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:28 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360 Nov 02 10:43:28 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:28 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:28 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:28 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Deleted volume successfully. Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3085e9c9-b6ee-4b64-9a39-fb40333638d3 tempest-VolumesNegativeTest-1729845929 None] Lock "cinder-47867cb4-3650-406b-9390-cf8ea9bc4b1c-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:28 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d32d490a-e108-490b-b266-8dfbef596360" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-d32d490a-e108-490b-b266-8dfbef596360" released by "delete_volume" :: held 0.777s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:28 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:28 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Deleted volume successfully. Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Created reservations ['361a9e24-351e-491e-b08f-3fa2eb08d500', '0c5aa7ae-02a0-4c01-8d44-ffadf6bbcf9c', '631787cf-74c0-4a52-bbd0-15a1ce20f69b', '863fdb49-48a4-4244-bd47-e0882e37a1d3'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-480ef63a-e472-4f66-8a8e-a773efa19489 tempest-VolumesTransfersV357Test-1382785375 None] Lock "cinder-c1efca21-53b9-48b1-8f3a-6e88d127ffe3-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:29 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:29 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:29 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.256s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Deleted volume successfully. Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7acb404e-96d6-478c-b518-1f905a6d9a57 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-d32d490a-e108-490b-b266-8dfbef596360-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:29 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:29 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:29 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-41b2d7f9-6272-49a1-8c99-872c87d7ed13 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Retype volume completed successfully. Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (8b520dce-9a38-4f74-a6a2-9f16d7ec01ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aec3540-712a-4bf2-a5f1-a9dca28d202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aec3540-712a-4bf2-a5f1-a9dca28d202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-618027586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4402c103-c3c2-4f24-b542-c961e141afdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:30Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3d2f25-6b97-4fb9-9a15-20331a25fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3d2f25-6b97-4fb9-9a15-20331a25fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650d731f-d4dd-4d6b-855a-d8d1a1b42860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650d731f-d4dd-4d6b-855a-d8d1a1b42860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4402c103-c3c2-4f24-b542-c961e141afdc', 'volume_name': 'volume-4402c103-c3c2-4f24-b542-c961e141afdc', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c42aaf-d3b4-4b00-bfa5-ba3b0997c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c42aaf-d3b4-4b00-bfa5-ba3b0997c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb27847-3834-4b8c-b56c-a486f7802ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:30 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Volume 4402c103-c3c2-4f24-b542-c961e141afdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4402c103-c3c2-4f24-b542-c961e141afdc', 'volume_size': 1} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-618027586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4402c103-c3c2-4f24-b542-c961e141afdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:30Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Creating volume 4402c103-c3c2-4f24-b542-c961e141afdc {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:30 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:30 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc 1073741824 Nov 02 10:43:30 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:30 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc 1073741824" returned: 0 in 0.566s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:30 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc Nov 02 10:43:30 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:31 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb27847-3834-4b8c-b56c-a486f7802ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4402c103-c3c2-4f24-b542-c961e141afdc', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2371849-6273-4732-985e-4a132d14efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:31 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Volume volume-4402c103-c3c2-4f24-b542-c961e141afdc (4402c103-c3c2-4f24-b542-c961e141afdc): created successfully Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2371849-6273-4732-985e-4a132d14efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (8b520dce-9a38-4f74-a6a2-9f16d7ec01ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:31 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-190473aa-8309-4fee-b96e-15d6f2ebdf9e tempest-VolumesActionsTest-1736867463 None] Created volume successfully. Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Acquiring lock "cinder-be665070-56e3-4678-ae3f-9baaa2b09aea-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "cinder-be665070-56e3-4678-ae3f-9baaa2b09aea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Acquiring lock "cinder-quobyte-be665070-56e3-4678-ae3f-9baaa2b09aea" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "cinder-quobyte-be665070-56e3-4678-ae3f-9baaa2b09aea" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5c8d38-8e6b-4e6f-a6d3-3bd7cd53d9fb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:31 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea Nov 02 10:43:31 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:31 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea" returned: 0 in 0.414s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:31 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea Nov 02 10:43:31 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:32 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be665070-56e3-4678-ae3f-9baaa2b09aea" returned: 0 in 0.349s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "cinder-quobyte-be665070-56e3-4678-ae3f-9baaa2b09aea" released by "delete_volume" :: held 0.837s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:32 devstack cinder-volume[86926]: WARNING cinder.quota [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:43:32 devstack cinder-volume[86926]: WARNING cinder.quota [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Created reservations ['164bb36c-fee4-4c84-b94e-af6a4993a100', 'ed6050a8-96f0-401e-b607-9198280b2b16', 'aa84f678-6a06-401a-b653-0a74f0244c65', '0e573976-a8bb-44ab-b7c7-00024ebb2846'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:32 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:32 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-4402c103-c3c2-4f24-b542-c961e141afdc-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-4402c103-c3c2-4f24-b542-c961e141afdc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-quobyte-4402c103-c3c2-4f24-b542-c961e141afdc" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-4402c103-c3c2-4f24-b542-c961e141afdc" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[44689a15-59d2-4b60-be60-a15ffd41a7df]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:32 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc Nov 02 10:43:32 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:32 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.552s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Deleted volume successfully. Nov 02 10:43:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54e65d02-4c80-4696-bb12-fcd96c5880a5 tempest-VolumeRetypeWithoutMigrationTest-811003332 None] Lock "cinder-be665070-56e3-4678-ae3f-9baaa2b09aea-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:33 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc" returned: 0 in 0.591s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:33 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc Nov 02 10:43:33 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:33 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4402c103-c3c2-4f24-b542-c961e141afdc" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-4402c103-c3c2-4f24-b542-c961e141afdc" released by "delete_volume" :: held 0.928s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Created reservations ['d4a90d32-907c-4794-b917-123a65a32b31', '005ca31c-1794-4314-96ae-360a79195c4f', 'b3de918e-84ea-4f8a-bdcd-436c9814652b', 'f80d638e-4e91-4d43-b34a-5b9323812e31'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:33 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:33 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:34 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.352s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:34 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Deleted volume successfully. Nov 02 10:43:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e77b34b8-2b13-415f-ac69-213d17cec2b7 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-4402c103-c3c2-4f24-b542-c961e141afdc-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (f8f2cf7a-daaa-4a14-81dd-4e2bd441039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b597d6-c5ba-4f7e-b004-2295d8a53e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b597d6-c5ba-4f7e-b004-2295d8a53e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-628882115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f37bf7-9616-46e0-9b26-10092c40053d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:36Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdaa208-73c0-4227-9586-fa1bb508aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdaa208-73c0-4227-9586-fa1bb508aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbcf9ab-81f9-4571-8f5f-40b20d708125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbcf9ab-81f9-4571-8f5f-40b20d708125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f37bf7-9616-46e0-9b26-10092c40053d', 'volume_name': 'volume-00f37bf7-9616-46e0-9b26-10092c40053d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd69c58-8725-4757-b671-ccbab9859753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd69c58-8725-4757-b671-ccbab9859753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8109eaf8-50f4-4de9-a235-469fe38b7374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Volume 00f37bf7-9616-46e0-9b26-10092c40053d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f37bf7-9616-46e0-9b26-10092c40053d', 'volume_size': 1} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-628882115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f37bf7-9616-46e0-9b26-10092c40053d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:36Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Creating volume 00f37bf7-9616-46e0-9b26-10092c40053d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:35 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:35 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d 1073741824 Nov 02 10:43:35 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Flow 'volume_create_manager' (6c5cc4b5-9f7c-470a-a316-5c95a0527719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f890de2d-b647-4be0-88d1-a5cc45921ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f890de2d-b647-4be0-88d1-a5cc45921ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-863370689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4e708e-c4ca-4222-87a6-48c48f9491d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25392dc31a1f45fe966f057c4e6252e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:36Z,use_quota=True,user_id='411924416bfc4eefa8911b61acabe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfddf5c6-3a99-4082-9b2b-f09c25d38293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfddf5c6-3a99-4082-9b2b-f09c25d38293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716a412f-bfab-49a9-a299-9e314b3bfa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716a412f-bfab-49a9-a299-9e314b3bfa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b4e708e-c4ca-4222-87a6-48c48f9491d8', 'volume_name': 'volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8', 'volume_size': 2}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13357a51-718c-4e16-af4b-c888d8faf7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13357a51-718c-4e16-af4b-c888d8faf7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3413a30b-d0e2-4854-a359-e0e37e7013e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:36 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Volume 6b4e708e-c4ca-4222-87a6-48c48f9491d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8', 'volume_size': 2} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:36 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d 1073741824" returned: 0 in 0.646s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:36 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d Nov 02 10:43:36 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:36 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-863370689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4e708e-c4ca-4222-87a6-48c48f9491d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25392dc31a1f45fe966f057c4e6252e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:36Z,use_quota=True,user_id='411924416bfc4eefa8911b61acabe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Creating volume 6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:36 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 2147483648 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8109eaf8-50f4-4de9-a235-469fe38b7374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f37bf7-9616-46e0-9b26-10092c40053d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:37 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 2147483648 Nov 02 10:43:37 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de579f09-25a9-4499-8bae-3613ea2fdf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:37 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Volume volume-00f37bf7-9616-46e0-9b26-10092c40053d (00f37bf7-9616-46e0-9b26-10092c40053d): created successfully Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de579f09-25a9-4499-8bae-3613ea2fdf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (f8f2cf7a-daaa-4a14-81dd-4e2bd441039e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f5f18cc0-16d7-440f-b86b-58dca66c894d tempest-VolumesActionsTest-1736867463 None] Created volume successfully. Nov 02 10:43:37 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 2147483648" returned: 0 in 0.690s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:37 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 Nov 02 10:43:37 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-00f37bf7-9616-46e0-9b26-10092c40053d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Lock "cinder-00f37bf7-9616-46e0-9b26-10092c40053d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:38 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8" returned: 0 in 0.342s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-quobyte-00f37bf7-9616-46e0-9b26-10092c40053d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3413a30b-d0e2-4854-a359-e0e37e7013e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8', 'volume_size': 2}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d984ea6-c4e2-40a2-9342-c8fb5f3fe8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-00f37bf7-9616-46e0-9b26-10092c40053d" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:38 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Volume volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 (6b4e708e-c4ca-4222-87a6-48c48f9491d8): created successfully Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d984ea6-c4e2-40a2-9342-c8fb5f3fe8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Flow 'volume_create_manager' (6c5cc4b5-9f7c-470a-a316-5c95a0527719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5182c17-b449-49cc-a06e-526d37c7665e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b35cc1a4-51f5-4682-89bc-f99d314f816c tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Created volume successfully. Nov 02 10:43:38 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d Nov 02 10:43:38 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:38 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:38 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d Nov 02 10:43:38 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:38 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-00f37bf7-9616-46e0-9b26-10092c40053d" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-00f37bf7-9616-46e0-9b26-10092c40053d" released by "delete_volume" :: held 0.806s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:38 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Created reservations ['c387a8e2-c2ac-43a2-9914-6360ae091679', '01091326-e5f5-420a-8755-649816ece12b', 'ba444196-c594-4e1d-a857-36a4f18a0080', '79d9502e-b241-4a15-8d65-10a8e8ec0728'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:39 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:39 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Creating offline snapshot a8f99d3c-b42c-4123-b9e1-5562724a3b52 of volume 6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:43:39 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.508s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da53663-1380-45d8-96d2-1a347aea5b85]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Deleted volume successfully. Nov 02 10:43:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b1059893-3715-4058-936a-aa1a0ae8397b tempest-VolumesActionsTest-1837380288 None] Lock "cinder-00f37bf7-9616-46e0-9b26-10092c40053d-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:39 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 Nov 02 10:43:39 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:40 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8" returned: 0 in 0.547s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 2G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:40 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 2G Nov 02 10:43:40 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (c78ad302-4e81-41c5-9329-839a24ff7f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a44b63-d4dd-4c52-87ec-8f8292582594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a44b63-d4dd-4c52-87ec-8f8292582594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-719736079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575e0907-7947-4ba6-a092-5ffff5498442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:40Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219b5387-d8ca-42ac-b323-dd42f7b23813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219b5387-d8ca-42ac-b323-dd42f7b23813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0300dd-fc4a-488a-a078-4260bdcd1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0300dd-fc4a-488a-a078-4260bdcd1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '575e0907-7947-4ba6-a092-5ffff5498442', 'volume_name': 'volume-575e0907-7947-4ba6-a092-5ffff5498442', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f174732-c4d8-48f7-880f-9b109c1f9941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f174732-c4d8-48f7-880f-9b109c1f9941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0682133f-ea0d-450d-b107-19f48b248cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Volume 575e0907-7947-4ba6-a092-5ffff5498442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-575e0907-7947-4ba6-a092-5ffff5498442', 'volume_size': 1} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:40 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 2G" returned: 0 in 0.508s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:40 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 Nov 02 10:43:40 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:41 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52" returned: 0 in 0.403s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:41 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 is being set with open permissions: ugo+rw Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:41 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 Nov 02 10:43:41 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:41 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52" returned: 0 in 0.284s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:41 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info Nov 02 10:43:41 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:41 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Flow 'volume_create_manager' (d1ab7297-b57b-4b3f-9f45-dc11f45d4b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de090c5-b3a1-44e6-8e3f-3ec9b803954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info" returned: 0 in 0.315s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:41 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info is being set with open permissions: ugo+rw Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:41 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info Nov 02 10:43:41 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de090c5-b3a1-44e6-8e3f-3ec9b803954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-737151002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc215c0c-0145-4c39-bc24-fa647cbc2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3ff92636e3489cac9e35faa27c7dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:42Z,use_quota=True,user_id='2d620ed529d842e1899470dea8ae036a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f4ade3-d8b5-41bc-97e7-58207f2118ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f4ade3-d8b5-41bc-97e7-58207f2118ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c046d829-64b7-4735-8f6f-c19f7aef4f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c046d829-64b7-4735-8f6f-c19f7aef4f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc215c0c-0145-4c39-bc24-fa647cbc2b04', 'volume_name': 'volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60044398-ca64-497a-9d97-304862919c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60044398-ca64-497a-9d97-304862919c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28db95d-2b35-48d9-aa89-2f4502df57c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Volume fc215c0c-0145-4c39-bc24-fa647cbc2b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04', 'volume_size': 1} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:41 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.info" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-719736079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575e0907-7947-4ba6-a092-5ffff5498442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:40Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Creating volume 575e0907-7947-4ba6-a092-5ffff5498442 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:41 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:42 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 1073741824 Nov 02 10:43:42 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-84fbd3ab-6180-4903-aee5-de59b85b00a3 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Create snapshot completed successfully Nov 02 10:43:42 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 1073741824" returned: 0 in 0.481s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:42 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 Nov 02 10:43:42 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "cinder-a8f99d3c-b42c-4123-b9e1-5562724a3b52-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-a8f99d3c-b42c-4123-b9e1-5562724a3b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "cinder-quobyte-6b4e708e-c4ca-4222-87a6-48c48f9491d8" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:42 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-quobyte-6b4e708e-c4ca-4222-87a6-48c48f9491d8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "cinder-quobyte-a8f99d3c-b42c-4123-b9e1-5562724a3b52" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-737151002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc215c0c-0145-4c39-bc24-fa647cbc2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3ff92636e3489cac9e35faa27c7dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:42Z,use_quota=True,user_id='2d620ed529d842e1899470dea8ae036a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Creating volume fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:42 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-quobyte-a8f99d3c-b42c-4123-b9e1-5562724a3b52" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Deleting offline snapshot a8f99d3c-b42c-4123-b9e1-5562724a3b52 of volume 6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:43:42 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 1073741824 Nov 02 10:43:42 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] snapshot_file for this snap is: volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0682133f-ea0d-450d-b107-19f48b248cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575e0907-7947-4ba6-a092-5ffff5498442', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b652ffb3-e9e7-4328-953e-31f1a2971b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d7f9c3-bc62-4733-a71c-98c2617fafb0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:42 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Volume volume-575e0907-7947-4ba6-a092-5ffff5498442 (575e0907-7947-4ba6-a092-5ffff5498442): created successfully Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b652ffb3-e9e7-4328-953e-31f1a2971b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (c78ad302-4e81-41c5-9329-839a24ff7f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f143ca2d-d153-4815-ac68-47fe388f3a3a tempest-VolumesActionsTest-1736867463 None] Created volume successfully. Nov 02 10:43:42 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 Nov 02 10:43:42 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52" returned: 0 in 0.469s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:43:43 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 1073741824" returned: 0 in 0.579s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a205787a-81da-425a-89d1-b37c3414dffb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:43 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 Nov 02 10:43:43 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-575e0907-7947-4ba6-a092-5ffff5498442-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Flow 'volume_create_manager' (fe79f719-91ac-495a-8c39-20540d447181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c73e157-e471-449b-bb5c-1594a1637ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-575e0907-7947-4ba6-a092-5ffff5498442-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:43 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 Nov 02 10:43:43 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c73e157-e471-449b-bb5c-1594a1637ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17c4e03-e890-42d6-9795-b950097f812c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ccdabcc11241c9aab7fae0d4b87266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:43Z,use_quota=True,user_id='84ff54f5875d4198a27b1374852372e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afe6672a-ff24-43c5-98cf-75a95cb0044d),volume_type_id=afe6672a-ff24-43c5-98cf-75a95cb0044d)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dac8c5-4f91-459c-8213-5bf065cc389e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dac8c5-4f91-459c-8213-5bf065cc389e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ca598e-449d-46bb-8486-97f5d6e2930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "cinder-quobyte-575e0907-7947-4ba6-a092-5ffff5498442" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-575e0907-7947-4ba6-a092-5ffff5498442" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c04efe-089d-4384-8038-7397a847d747]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:43 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04" returned: 0 in 0.315s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28db95d-2b35-48d9-aa89-2f4502df57c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202a2dbf-b609-4e6a-8ed0-492cf71a826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Volume volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 (fc215c0c-0145-4c39-bc24-fa647cbc2b04): created successfully Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202a2dbf-b609-4e6a-8ed0-492cf71a826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Flow 'volume_create_manager' (d1ab7297-b57b-4b3f-9f45-dc11f45d4b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:43 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7568afdd-5327-4337-9d00-1d7254d3bde8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Created volume successfully. Nov 02 10:43:43 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 Nov 02 10:43:43 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8" returned: 0 in 0.510s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:43 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 Nov 02 10:43:43 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ca598e-449d-46bb-8486-97f5d6e2930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a17c4e03-e890-42d6-9795-b950097f812c', 'volume_name': 'volume-a17c4e03-e890-42d6-9795-b950097f812c', 'volume_size': 1, 'image_id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30062ed7-f088-4903-9b16-3fe3b39d5330', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '650ac36c0309bdfd6dd500a24dfab75b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2ccdabcc11241c9aab7fae0d4b87266', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7a5b38bd31af7a5105831a7d21e201b1f63fa8108ede5cf79414c1b346d5fcb2954b449b72acfc13149acc6e6a4d208d6675f208d378c1f56e95fb598e85a76', 'id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'created_at': datetime.datetime(2026, 11, 2, 9, 43, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 43, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30062ed7-f088-4903-9b16-3fe3b39d5330/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4ba41a-b666-469f-bef3-0ad7bbee7b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4ba41a-b666-469f-bef3-0ad7bbee7b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9cf457-f2e1-4482-b879-d1eb92436ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Volume a17c4e03-e890-42d6-9795-b950097f812c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a17c4e03-e890-42d6-9795-b950097f812c', 'volume_size': 1, 'image_id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30062ed7-f088-4903-9b16-3fe3b39d5330', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '650ac36c0309bdfd6dd500a24dfab75b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2ccdabcc11241c9aab7fae0d4b87266', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7a5b38bd31af7a5105831a7d21e201b1f63fa8108ede5cf79414c1b346d5fcb2954b449b72acfc13149acc6e6a4d208d6675f208d378c1f56e95fb598e85a76', 'id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'created_at': datetime.datetime(2026, 11, 2, 9, 43, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 43, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30062ed7-f088-4903-9b16-3fe3b39d5330/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:43:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Trying to clone a17c4e03-e890-42d6-9795-b950097f812c from image 30062ed7-f088-4903-9b16-3fe3b39d5330 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30062ed7-f088-4903-9b16-3fe3b39d5330', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:43:44 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27dee6b-5cc2-45f9-8bb5-b792c4c533ba]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442" returned: 0 in 0.447s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442 Nov 02 10:43:44 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD Nov 02 10:43:44 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52" returned: 0 in 0.401s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52 Nov 02 10:43:44 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-575e0907-7947-4ba6-a092-5ffff5498442" returned: 0 in 0.303s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-quobyte-575e0907-7947-4ba6-a092-5ffff5498442" released by "delete_volume" :: held 0.809s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:44 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Created reservations ['1626ffbe-9d79-4fd7-a7bd-42e230d26beb', '4c2f1627-a1b8-40c2-b86f-cbaf5e594fdb', '65f0dc8e-5807-477b-ae00-5efd339aa92b', 'a9bd501d-95a3-4bfd-99a5-1ef11479f143'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:44 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8.a8f99d3c-b42c-4123-b9e1-5562724a3b52" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD Nov 02 10:43:44 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-quobyte-a8f99d3c-b42c-4123-b9e1-5562724a3b52" released by "_delete_snapshot" :: held 1.813s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-quobyte-6b4e708e-c4ca-4222-87a6-48c48f9491d8" released by "delete_snapshot" :: held 1.869s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:44 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Created reservations ['ce37d249-3215-48b0-9832-1f26f8fdc44c', '10333674-b661-43e6-936f-c976c9ce420a', '4a288e91-ad41-4a86-81f7-d760c64a20bc', 'b14c916f-9da3-45c7-87f7-cd9c3a6519a3'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:44 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Temporary image 30062ed7-f088-4903-9b16-3fe3b39d5330 is fetched for user 84ff54f5875d4198a27b1374852372e8. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:43:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Delete snapshot completed successfully. Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6b8be011-cebd-4f87-8800-ec8d6b250354 tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-a8f99d3c-b42c-4123-b9e1-5562724a3b52-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a05cf-e839-4e3c-aff8-e4943804a662]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD Nov 02 10:43:45 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.434s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Deleted volume successfully. Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Creating offline snapshot 437a9bf3-ce51-468b-b536-d4f71d0b920c of volume fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5dacf960-a6de-499a-bbd1-c842c8862890 tempest-VolumesActionsTest-1837380288 None] Lock "cinder-575e0907-7947-4ba6-a092-5ffff5498442-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[da49780e-9708-4858-aa3d-7d3b4b10b032]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "cinder-6b4e708e-c4ca-4222-87a6-48c48f9491d8-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-6b4e708e-c4ca-4222-87a6-48c48f9491d8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "cinder-quobyte-6b4e708e-c4ca-4222-87a6-48c48f9491d8" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:45 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 Nov 02 10:43:45 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-quobyte-6b4e708e-c4ca-4222-87a6-48c48f9491d8" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:45 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51a25ac-18a3-47b9-9e4b-fe8ce3d027eb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (abadb6dc-97b7-4934-8ffc-0ba6cb1036bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b2e993-624b-4eb3-b086-2fa0496f0767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b2e993-624b-4eb3-b086-2fa0496f0767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797893083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ec595b-d7f9-4096-b695-4080186072e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:45Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8975b1-75e6-478c-9a26-436651cb1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8975b1-75e6-478c-9a26-436651cb1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835be4c4-b544-4cc0-a22a-112d958dbad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835be4c4-b544-4cc0-a22a-112d958dbad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ec595b-d7f9-4096-b695-4080186072e8', 'volume_name': 'volume-c9ec595b-d7f9-4096-b695-4080186072e8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:45 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD Nov 02 10:43:45 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 Nov 02 10:43:45 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fc201e-80d7-4298-9162-c6b80870dbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fc201e-80d7-4298-9162-c6b80870dbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3843b14-0a68-434c-8423-7ec43c607a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:45 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Volume c9ec595b-d7f9-4096-b695-4080186072e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ec595b-d7f9-4096-b695-4080186072e8', 'volume_size': 1} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:45 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c 1G Nov 02 10:43:45 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:45 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8" returned: 0 in 0.430s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8 Nov 02 10:43:45 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:46 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c 1G" returned: 0 in 0.431s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:46 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6b4e708e-c4ca-4222-87a6-48c48f9491d8" returned: 0 in 0.254s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c Nov 02 10:43:46 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-quobyte-6b4e708e-c4ca-4222-87a6-48c48f9491d8" released by "delete_volume" :: held 0.771s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Created reservations ['1c1329d2-1921-46ec-9c4b-7128235f8ce0', '1cb818dd-d442-4763-9dca-f1baccb2765e', 'f8f44288-94f9-4bb4-aaa1-96908b63e751', '851e0f3d-f308-46eb-b246-c06ee261f7fc'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:46 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:46 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:46 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c" returned: 0 in 0.345s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c is being set with open permissions: ugo+rw Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:46 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c Nov 02 10:43:46 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:46 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Deleted volume successfully. Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06ce9c2b-a97b-4bc5-899a-37bd126f53cb tempest-VolumesSnapshotNegativeTestJSON-969392948 None] Lock "cinder-6b4e708e-c4ca-4222-87a6-48c48f9491d8-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:46 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:46 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info Nov 02 10:43:46 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:47 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:47 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info is being set with open permissions: ugo+rw Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:47 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info Nov 02 10:43:47 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:47 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.info" returned: 0 in 0.254s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797893083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ec595b-d7f9-4096-b695-4080186072e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c388f1ab7245bc8a32363bed3330a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:45Z,use_quota=True,user_id='fd553ff8ed3146b6abd512e9b21fd2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Creating volume c9ec595b-d7f9-4096-b695-4080186072e8 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:47 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:47 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 1073741824 Nov 02 10:43:47 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0949ea93-0a7b-452b-8167-f269630255de tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Create snapshot completed successfully Nov 02 10:43:47 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 1073741824" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:47 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 Nov 02 10:43:47 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:48 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17c4e03-e890-42d6-9795-b950097f812c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ccdabcc11241c9aab7fae0d4b87266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:43Z,use_quota=True,user_id='84ff54f5875d4198a27b1374852372e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afe6672a-ff24-43c5-98cf-75a95cb0044d),volume_type_id=afe6672a-ff24-43c5-98cf-75a95cb0044d)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Creating volume a17c4e03-e890-42d6-9795-b950097f812c {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3843b14-0a68-434c-8423-7ec43c607a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ec595b-d7f9-4096-b695-4080186072e8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:48 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c 1073741824 Nov 02 10:43:48 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a5c755-5202-4b29-8701-6323524e0ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Volume volume-c9ec595b-d7f9-4096-b695-4080186072e8 (c9ec595b-d7f9-4096-b695-4080186072e8): created successfully Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a5c755-5202-4b29-8701-6323524e0ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Flow 'volume_create_manager' (abadb6dc-97b7-4934-8ffc-0ba6cb1036bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1864b67b-0d71-4ee9-bf15-f1fead12379f tempest-VolumesActionsTest-1736867463 None] Created volume successfully. Nov 02 10:43:48 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c 1073741824" returned: 0 in 0.551s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:48 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c Nov 02 10:43:48 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "cinder-437a9bf3-ce51-468b-b536-d4f71d0b920c-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-437a9bf3-ce51-468b-b536-d4f71d0b920c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "cinder-quobyte-fc215c0c-0145-4c39-bc24-fa647cbc2b04" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-quobyte-fc215c0c-0145-4c39-bc24-fa647cbc2b04" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "cinder-quobyte-437a9bf3-ce51-468b-b536-d4f71d0b920c" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-quobyte-437a9bf3-ce51-468b-b536-d4f71d0b920c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Deleting offline snapshot 437a9bf3-ce51-468b-b536-d4f71d0b920c of volume fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] snapshot_file for this snap is: volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d9780-0cb6-4ad0-a39c-b4aee6bad12a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:49 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Attempting download of 30062ed7-f088-4903-9b16-3fe3b39d5330 ((None, [{'url': 'file:///opt/stack/data/glance/images/30062ed7-f088-4903-9b16-3fe3b39d5330', 'metadata': {}}])) to volume a17c4e03-e890-42d6-9795-b950097f812c. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:43:49 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c Nov 02 10:43:49 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aa28a0-e444-4d82-9dda-b28aa8fa6ecb]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:49 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1 Nov 02 10:43:49 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:49 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c" returned: 0 in 0.460s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Acquiring lock "cinder-c9ec595b-d7f9-4096-b695-4080186072e8-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9555f968-1420-4264-bfe8-c275eb8e12b3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:49 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1" returned: 0 in 0.393s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Lock "cinder-c9ec595b-d7f9-4096-b695-4080186072e8-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Acquiring lock "cinder-quobyte-c9ec595b-d7f9-4096-b695-4080186072e8" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Lock "cinder-quobyte-c9ec595b-d7f9-4096-b695-4080186072e8" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:49 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 Nov 02 10:43:49 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b6da0-d32c-4011-a6f6-9ecf9820f987]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:49 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1 Nov 02 10:43:49 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:49 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 Nov 02 10:43:49 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:49 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1" returned: 1 in 0.430s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30062ed7-f088-4903-9b16-3fe3b39d5330_2_2k2kx1' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd2b97-978a-4210-9aaa-54788ae74ed7]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04" returned: 0 in 0.510s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c Nov 02 10:43:50 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD Nov 02 10:43:50 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8" returned: 0 in 0.490s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8 Nov 02 10:43:50 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c" returned: 0 in 0.462s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c9ec595b-d7f9-4096-b695-4080186072e8" returned: 0 in 0.320s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c Nov 02 10:43:50 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD Nov 02 10:43:50 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Lock "cinder-quobyte-c9ec595b-d7f9-4096-b695-4080186072e8" released by "delete_volume" :: held 0.893s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Created reservations ['92827046-f2d1-4390-a869-0f1a43b999cb', '3a327738-4b96-4f07-a9c4-15c89fc5e618', '5b849ebf-1f83-4303-b625-c3a293c24728', '7b847fcd-aa04-48c9-bcf3-77c80a4d1f56'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] 30062ed7-f088-4903-9b16-3fe3b39d5330 was raw, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:43:50 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04.437a9bf3-ce51-468b-b536-d4f71d0b920c" returned: 0 in 0.437s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c Nov 02 10:43:50 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-quobyte-437a9bf3-ce51-468b-b536-d4f71d0b920c" released by "_delete_snapshot" :: held 2.047s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-quobyte-fc215c0c-0145-4c39-bc24-fa647cbc2b04" released by "delete_snapshot" :: held 2.079s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Created reservations ['2e55551f-3b5c-43ff-a931-7bd0001a9a40', '529d9b0f-4820-477b-b95d-01bb32bdfc16', '8e4dcee8-40e0-40ed-92ac-de4ae88bf335', 'daaeab61-9048-40f4-a2d4-0538efd7d98b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Delete snapshot completed successfully. Nov 02 10:43:51 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70b3eb24-462f-4a47-b513-ad3d1317166b tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-437a9bf3-ce51-468b-b536-d4f71d0b920c-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Deleted volume successfully. Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eca7d985-0b57-44d2-8835-956e36d4cfeb tempest-VolumesActionsTest-1736867463 None] Lock "cinder-c9ec595b-d7f9-4096-b695-4080186072e8-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:51 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c" returned: 0 in 0.551s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30062ed7-f088-4903-9b16-3fe3b39d5330_f4g49cutdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:43:51 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:51 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c 1G Nov 02 10:43:51 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:51 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c 1G" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Downloaded image 30062ed7-f088-4903-9b16-3fe3b39d5330 ((None, [{'url': 'file:///opt/stack/data/glance/images/30062ed7-f088-4903-9b16-3fe3b39d5330', 'metadata': {}}])) to volume a17c4e03-e890-42d6-9795-b950097f812c successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Temporary image 30062ed7-f088-4903-9b16-3fe3b39d5330 for user 84ff54f5875d4198a27b1374852372e8 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Marking volume a17c4e03-e890-42d6-9795-b950097f812c as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Copying metadata from image 30062ed7-f088-4903-9b16-3fe3b39d5330 to a17c4e03-e890-42d6-9795-b950097f812c. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Creating volume glance metadata for volume a17c4e03-e890-42d6-9795-b950097f812c backed by image 30062ed7-f088-4903-9b16-3fe3b39d5330 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '650ac36c0309bdfd6dd500a24dfab75b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9cf457-f2e1-4482-b879-d1eb92436ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17c4e03-e890-42d6-9795-b950097f812c', 'volume_size': 1, 'image_id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30062ed7-f088-4903-9b16-3fe3b39d5330', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '650ac36c0309bdfd6dd500a24dfab75b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2ccdabcc11241c9aab7fae0d4b87266', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7a5b38bd31af7a5105831a7d21e201b1f63fa8108ede5cf79414c1b346d5fcb2954b449b72acfc13149acc6e6a4d208d6675f208d378c1f56e95fb598e85a76', 'id': '30062ed7-f088-4903-9b16-3fe3b39d5330', 'created_at': datetime.datetime(2026, 11, 2, 9, 43, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 43, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30062ed7-f088-4903-9b16-3fe3b39d5330/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0833d9b9-2578-4389-af08-2187c080ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Volume volume-a17c4e03-e890-42d6-9795-b950097f812c (a17c4e03-e890-42d6-9795-b950097f812c): created successfully Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0833d9b9-2578-4389-af08-2187c080ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Flow 'volume_create_manager' (fe79f719-91ac-495a-8c39-20540d447181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a9847670-7d6c-4e52-875d-d2921603b87d tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Created volume successfully. Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Acquiring lock "cinder-a17c4e03-e890-42d6-9795-b950097f812c-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "cinder-a17c4e03-e890-42d6-9795-b950097f812c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "cinder-fc215c0c-0145-4c39-bc24-fa647cbc2b04-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-fc215c0c-0145-4c39-bc24-fa647cbc2b04-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Acquiring lock "cinder-quobyte-a17c4e03-e890-42d6-9795-b950097f812c" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "cinder-quobyte-a17c4e03-e890-42d6-9795-b950097f812c" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "cinder-quobyte-fc215c0c-0145-4c39-bc24-fa647cbc2b04" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-quobyte-fc215c0c-0145-4c39-bc24-fa647cbc2b04" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fe785-8bdd-4557-afa5-5601ea42c380]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[35552a21-463b-4bdf-95bb-e86f825c4b12]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:52 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c Nov 02 10:43:52 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:52 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 Nov 02 10:43:52 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:52 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:52 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04" returned: 0 in 0.468s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:52 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c Nov 02 10:43:52 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:52 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04 Nov 02 10:43:52 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:53 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a17c4e03-e890-42d6-9795-b950097f812c" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "cinder-quobyte-a17c4e03-e890-42d6-9795-b950097f812c" released by "delete_volume" :: held 0.882s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc215c0c-0145-4c39-bc24-fa647cbc2b04" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-quobyte-fc215c0c-0145-4c39-bc24-fa647cbc2b04" released by "delete_volume" :: held 0.879s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:53 devstack cinder-volume[86926]: WARNING cinder.quota [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:43:53 devstack cinder-volume[86926]: WARNING cinder.quota [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Created reservations ['131182e3-8eb2-4d9f-b5a4-e26c0a25a9e5', '55b8210c-4949-4c6b-b965-30047643a562', 'd25467d1-9bad-4780-91e4-9271d36bb1cd', '59e5c925-eeca-471b-b5ff-4382dd76ce18'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Created reservations ['aad61f19-b3b4-40ed-876b-7820b17c6aeb', '49eaaef7-eddc-4a16-a413-3233c30f489c', '38299e90-1c0f-4990-a436-eb44b89bf669', '95b60b37-e8a1-4a9e-8ac0-d2bcf4439bbb'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:53 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:53 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:53 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:43:53 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:53 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Deleted volume successfully. Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-04ded2ec-2202-418e-9eee-dd240e487789 tempest-VolumeAndVolumeTypeFromImageTest-226475324 None] Lock "cinder-a17c4e03-e890-42d6-9795-b950097f812c-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:53 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Deleted volume successfully. Nov 02 10:43:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb099a7c-cfbb-4bbf-95ef-7ccc70817acf tempest-VolumeSnapshotQuotasNegativeTestJSON-1887888781 None] Lock "cinder-fc215c0c-0145-4c39-bc24-fa647cbc2b04-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:03 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=123,cinder:UPDATE=157,cinder:INSERT=37,cinder:DELETE=18 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:03 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=150,cinder:UPDATE=197,cinder:DELETE=11,cinder:INSERT=56 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (1cee6276-89f8-42ca-af55-c93e8ff16fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b833788c-7f3a-4004-b1dc-046f44e92d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b833788c-7f3a-4004-b1dc-046f44e92d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686262037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dee2003-c6aa-40c0-8425-d7c1ad0b1f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:04Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ae6f4b-732a-4f76-b7d2-9cf6bd42f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ae6f4b-732a-4f76-b7d2-9cf6bd42f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8113da2e-7ab0-4f30-ab83-3837a3de2076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8113da2e-7ab0-4f30-ab83-3837a3de2076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dee2003-c6aa-40c0-8425-d7c1ad0b1f72', 'volume_name': 'volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48a3cb0-e095-4aca-9888-3e9e93d00c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48a3cb0-e095-4aca-9888-3e9e93d00c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5750cf44-6ed9-42bb-aaa5-b87bb717db39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Volume 0dee2003-c6aa-40c0-8425-d7c1ad0b1f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72', 'volume_size': 1} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686262037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dee2003-c6aa-40c0-8425-d7c1ad0b1f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:04Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Creating volume 0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:04 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 1073741824 Nov 02 10:44:04 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (c9e7997d-36ad-4588-96be-8da24f505db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14873b6c-2123-4a08-b834-53d7bb3e924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14873b6c-2123-4a08-b834-53d7bb3e924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131067976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683686df-0cbd-47ad-bf1e-0c54abcd02f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:05Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0e3811-7e79-43df-89e9-49045a9944eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0e3811-7e79-43df-89e9-49045a9944eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4e4467-f083-4089-93e7-ea9eb4863cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4e4467-f083-4089-93e7-ea9eb4863cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683686df-0cbd-47ad-bf1e-0c54abcd02f7', 'volume_name': 'volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e139f5-6859-4c1c-8f36-a6a8e8b5168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e139f5-6859-4c1c-8f36-a6a8e8b5168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cda84e8-501a-49a4-9051-744655fe6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Volume 683686df-0cbd-47ad-bf1e-0c54abcd02f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7', 'volume_size': 1} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:05 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 1073741824" returned: 0 in 0.733s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:05 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 Nov 02 10:44:05 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (2e45d83d-2f04-42a6-99f6-4bae8eabfd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad04b1e-ac5d-435d-b495-13dd7cf69054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad04b1e-ac5d-435d-b495-13dd7cf69054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055960710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0977257-1d85-4f33-aa0d-a125d054836a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:05Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053f1a82-7f46-4aa6-b581-19eab5605795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053f1a82-7f46-4aa6-b581-19eab5605795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf679a7-30ad-4020-ab7c-35d4beb2f303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf679a7-30ad-4020-ab7c-35d4beb2f303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0977257-1d85-4f33-aa0d-a125d054836a', 'volume_name': 'volume-c0977257-1d85-4f33-aa0d-a125d054836a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433f2f54-c09a-4983-b00f-98eca9f5bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433f2f54-c09a-4983-b00f-98eca9f5bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c9af2e-c1ae-498d-b554-ef387a737513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Volume c0977257-1d85-4f33-aa0d-a125d054836a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0977257-1d85-4f33-aa0d-a125d054836a', 'volume_size': 1} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:05 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72" returned: 0 in 0.490s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131067976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683686df-0cbd-47ad-bf1e-0c54abcd02f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:05Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Creating volume 683686df-0cbd-47ad-bf1e-0c54abcd02f7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:05 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5750cf44-6ed9-42bb-aaa5-b87bb717db39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2badb8e9-3d4b-4785-8b7c-c98a7b12166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:05 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 1073741824 Nov 02 10:44:05 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Volume volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 (0dee2003-c6aa-40c0-8425-d7c1ad0b1f72): created successfully Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2badb8e9-3d4b-4785-8b7c-c98a7b12166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (1cee6276-89f8-42ca-af55-c93e8ff16fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7820acf1-7a8b-4884-92b7-374b44c3d9d5 tempest-CreateVolumesFromImageTest-1297245508 None] Created volume successfully. Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (fd019b32-4e46-4035-9098-1ed58d15f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ad75b1-1e58-4b39-9a0f-f514ceb6f3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ad75b1-1e58-4b39-9a0f-f514ceb6f3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663060261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7bd924-d8c8-43a6-9a82-1be2bcb08f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:06Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ff88d0-0d3c-46fb-839e-967ff4a12851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ff88d0-0d3c-46fb-839e-967ff4a12851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1b255c-f9fe-4e7a-a69c-3a213e912f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1b255c-f9fe-4e7a-a69c-3a213e912f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7bd924-d8c8-43a6-9a82-1be2bcb08f04', 'volume_name': 'volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6c2246-15d5-45b9-9f11-9c95793a386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6c2246-15d5-45b9-9f11-9c95793a386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c71d38-587e-45bd-85fb-299facd80001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Volume ed7bd924-d8c8-43a6-9a82-1be2bcb08f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04', 'volume_size': 1} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (d3573234-c7d6-4077-8121-9b3685cf5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eecb67-c386-49ad-bbf2-d32326f9db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eecb67-c386-49ad-bbf2-d32326f9db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1152710077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aaa4dc-4e81-4c2f-9090-ac815fdd7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:06Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e63aecc-0e14-414d-bdcb-4acce27acf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e63aecc-0e14-414d-bdcb-4acce27acf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae38dc50-79ce-41cc-9a3c-39074dec9a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae38dc50-79ce-41cc-9a3c-39074dec9a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4aaa4dc-4e81-4c2f-9090-ac815fdd7200', 'volume_name': 'volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ca80a-f8a0-4de2-88a6-c3bb471248d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ca80a-f8a0-4de2-88a6-c3bb471248d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425eca2e-ca3a-44cc-be8e-0b0935ae32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Volume b4aaa4dc-4e81-4c2f-9090-ac815fdd7200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200', 'volume_size': 1} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 1073741824" returned: 0 in 0.870s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:06 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 Nov 02 10:44:06 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:07 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7" returned: 0 in 0.341s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055960710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0977257-1d85-4f33-aa0d-a125d054836a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:05Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Creating volume c0977257-1d85-4f33-aa0d-a125d054836a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:07 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cda84e8-501a-49a4-9051-744655fe6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:07 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a 1073741824 Nov 02 10:44:07 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc0621f-c9fa-4e7e-9bff-ea3f1c952994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:07 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Volume volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 (683686df-0cbd-47ad-bf1e-0c54abcd02f7): created successfully Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc0621f-c9fa-4e7e-9bff-ea3f1c952994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (c9e7997d-36ad-4588-96be-8da24f505db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0a406609-ef9d-43e2-a355-bbec6aaf27e6 tempest-CreateVolumesFromImageTest-1297245508 None] Created volume successfully. Nov 02 10:44:07 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a 1073741824" returned: 0 in 0.650s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:07 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a Nov 02 10:44:07 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:08 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a" returned: 0 in 0.414s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663060261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7bd924-d8c8-43a6-9a82-1be2bcb08f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:06Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Creating volume ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:08 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c9af2e-c1ae-498d-b554-ef387a737513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0977257-1d85-4f33-aa0d-a125d054836a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:08 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 1073741824 Nov 02 10:44:08 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7761245b-36e0-4cfd-a760-0e22e7a3d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:08 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Volume volume-c0977257-1d85-4f33-aa0d-a125d054836a (c0977257-1d85-4f33-aa0d-a125d054836a): created successfully Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7761245b-36e0-4cfd-a760-0e22e7a3d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (2e45d83d-2f04-42a6-99f6-4bae8eabfd47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-da482aba-1c92-42e0-8c05-7eb2c1dda934 tempest-CreateVolumesFromImageTest-1297245508 None] Created volume successfully. Nov 02 10:44:08 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 1073741824" returned: 0 in 0.638s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:08 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 Nov 02 10:44:08 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:09 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.563s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1152710077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aaa4dc-4e81-4c2f-9090-ac815fdd7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1b1620728f441e84a471d80962fdcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:06Z,use_quota=True,user_id='062b65339af147649dc81512a781ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Creating volume b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:09 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c71d38-587e-45bd-85fb-299facd80001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fef8c30-cf5a-4e9d-a5d4-e75deae0efcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:09 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 1073741824 Nov 02 10:44:09 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:09 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Volume volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 (ed7bd924-d8c8-43a6-9a82-1be2bcb08f04): created successfully Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fef8c30-cf5a-4e9d-a5d4-e75deae0efcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (fd019b32-4e46-4035-9098-1ed58d15f069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:09 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-85475e10-bdd7-4ae5-9f56-e5cd676a78b3 tempest-CreateVolumesFromImageTest-1297245508 None] Created volume successfully. Nov 02 10:44:09 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 1073741824" returned: 0 in 0.706s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:09 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 Nov 02 10:44:09 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:10 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200" returned: 0 in 0.288s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425eca2e-ca3a-44cc-be8e-0b0935ae32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcd09fe-d703-4f8f-8cf2-31c4158cf60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:10 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Volume volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 (b4aaa4dc-4e81-4c2f-9090-ac815fdd7200): created successfully Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcd09fe-d703-4f8f-8cf2-31c4158cf60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Flow 'volume_create_manager' (d3573234-c7d6-4077-8121-9b3685cf5839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:10 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9475ac34-a649-455e-83a0-c8f33d352f65 tempest-CreateVolumesFromImageTest-1297245508 None] Created volume successfully. Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-quobyte-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b9eb7a-dd8d-4a9e-bf96-e2ade163ad9f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:11 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 Nov 02 10:44:11 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:11 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200" returned: 0 in 0.540s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:11 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200 Nov 02 10:44:11 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:12 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200" released by "delete_volume" :: held 0.943s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Created reservations ['3ee393e2-746a-41b6-9170-3a2fe25079af', '8ef61986-c2f2-450f-84d5-91e281a9ada1', '144c5257-d845-46a6-9d4a-1a494271b388', '7b03850b-af41-4757-8cef-ce028ced7ecc'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:12 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:12 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:12 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.324s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Deleted volume successfully. Nov 02 10:44:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cf2af307-d305-4129-982b-1d521723530a tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-b4aaa4dc-4e81-4c2f-9090-ac815fdd7200-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-quobyte-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad1b0be-75a6-4c2b-b858-8fa26703c854]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:13 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 Nov 02 10:44:13 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:14 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04" returned: 0 in 0.668s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:14 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04 Nov 02 10:44:14 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:14 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04" returned: 0 in 0.357s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04" released by "delete_volume" :: held 1.099s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Created reservations ['30875c4e-b181-4699-bcb9-8ab85cf97503', '36f862a2-c41d-4ce9-8d30-65e02d1f18ed', '62a13e5f-fc47-4ffd-8a8b-ac4c0383256a', '4ee98205-490a-443a-a638-566af7933816'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:15 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:15 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:15 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.335s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:15 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Deleted volume successfully. Nov 02 10:44:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ecea8edd-1847-4b3f-955c-8855c30af0a3 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-ed7bd924-d8c8-43a6-9a82-1be2bcb08f04-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-c0977257-1d85-4f33-aa0d-a125d054836a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-c0977257-1d85-4f33-aa0d-a125d054836a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-quobyte-c0977257-1d85-4f33-aa0d-a125d054836a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-c0977257-1d85-4f33-aa0d-a125d054836a" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[68edf1cc-fb51-4b6f-8668-e6b70b3cbdc6]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:16 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a Nov 02 10:44:16 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:16 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a" returned: 0 in 0.544s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:16 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a Nov 02 10:44:16 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Flow 'volume_create_manager' (dba13f61-2bdd-48db-890c-86336b16fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd60e481-73c4-47ec-9003-c4c49b0c6598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd60e481-73c4-47ec-9003-c4c49b0c6598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1814514920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b2be65-9be3-4f5e-b95a-0b854d7174de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627f8390f0d485aa67dbc2613a0dc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:17Z,use_quota=True,user_id='426013363e1643e7941f49702e3d3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36134954-3cf0-46ab-baa2-fe4c2347297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36134954-3cf0-46ab-baa2-fe4c2347297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95423da-fe9f-4bff-8a4b-cbe4103d07fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95423da-fe9f-4bff-8a4b-cbe4103d07fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b2be65-9be3-4f5e-b95a-0b854d7174de', 'volume_name': 'volume-49b2be65-9be3-4f5e-b95a-0b854d7174de', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbd799e-faf9-41ee-805b-1b31e5eadf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbd799e-faf9-41ee-805b-1b31e5eadf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cd89db-856e-4e79-877c-b33671792e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:16 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Volume 49b2be65-9be3-4f5e-b95a-0b854d7174de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b2be65-9be3-4f5e-b95a-0b854d7174de', 'volume_size': 1} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1814514920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b2be65-9be3-4f5e-b95a-0b854d7174de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627f8390f0d485aa67dbc2613a0dc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:17Z,use_quota=True,user_id='426013363e1643e7941f49702e3d3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Creating volume 49b2be65-9be3-4f5e-b95a-0b854d7174de {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:16 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:16 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de 1073741824 Nov 02 10:44:16 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:16 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c0977257-1d85-4f33-aa0d-a125d054836a" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-c0977257-1d85-4f33-aa0d-a125d054836a" released by "delete_volume" :: held 0.963s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Created reservations ['ca397d5d-5390-46fd-9d8e-4d768f6c608a', '6ea6adda-afeb-4dfe-a026-6569558f0023', '364211ae-1bd4-49fd-b204-eea97fea2b66', 'bb4e2662-59d7-4539-befe-63969327b0f5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:17 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:17 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:17 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de 1073741824" returned: 0 in 0.726s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:17 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.428s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:17 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de Nov 02 10:44:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Deleted volume successfully. Nov 02 10:44:17 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-640bd4d1-4e62-4d4f-bdd5-60800537d390 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-c0977257-1d85-4f33-aa0d-a125d054836a-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:17 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cd89db-856e-4e79-877c-b33671792e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b2be65-9be3-4f5e-b95a-0b854d7174de', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac043f1-6079-42ef-8e90-80bcf6bba578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:17 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Volume volume-49b2be65-9be3-4f5e-b95a-0b854d7174de (49b2be65-9be3-4f5e-b95a-0b854d7174de): created successfully Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac043f1-6079-42ef-8e90-80bcf6bba578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Flow 'volume_create_manager' (dba13f61-2bdd-48db-890c-86336b16fef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-179d7ecf-0a60-4c3f-bb84-8da02d40675b tempest-VolumesListAdminTestJSON-1003222023 None] Created volume successfully. Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-683686df-0cbd-47ad-bf1e-0c54abcd02f7-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-683686df-0cbd-47ad-bf1e-0c54abcd02f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-quobyte-683686df-0cbd-47ad-bf1e-0c54abcd02f7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-683686df-0cbd-47ad-bf1e-0c54abcd02f7" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[643f979d-2642-41d3-8ef0-83b2f291b01d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:18 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 Nov 02 10:44:18 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:18 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7" returned: 0 in 0.466s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:18 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7 Nov 02 10:44:18 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:19 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-683686df-0cbd-47ad-bf1e-0c54abcd02f7" returned: 0 in 0.384s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-683686df-0cbd-47ad-bf1e-0c54abcd02f7" released by "delete_volume" :: held 0.924s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Created reservations ['79929950-6100-4f3e-baee-0dfbefdca54c', 'd725877b-39a9-4050-85fe-1663cd98bfd4', '6cd2fedf-fda8-4b62-ab9e-4f7d01a6957a', '85ca548b-8f72-4608-8dce-68e3b711b686'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:19 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:19 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Flow 'volume_create_manager' (660e5fee-f640-4d73-a889-84594bbbf8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410af1d-9839-4686-8c1c-0a9e5a249ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410af1d-9839-4686-8c1c-0a9e5a249ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2105135588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f991b821-53db-454a-abff-d93ba7fc7c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627f8390f0d485aa67dbc2613a0dc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:19Z,use_quota=True,user_id='426013363e1643e7941f49702e3d3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec54508-72c3-482e-9147-ca0426723699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec54508-72c3-482e-9147-ca0426723699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a655eebc-81df-4b23-8102-11b4a7918276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a655eebc-81df-4b23-8102-11b4a7918276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f991b821-53db-454a-abff-d93ba7fc7c56', 'volume_name': 'volume-f991b821-53db-454a-abff-d93ba7fc7c56', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5496e7-325e-45c6-b4ea-fde42694ad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5496e7-325e-45c6-b4ea-fde42694ad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8196715-b011-40c4-bc41-d05bf59ddd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Volume f991b821-53db-454a-abff-d93ba7fc7c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f991b821-53db-454a-abff-d93ba7fc7c56', 'volume_size': 1} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2105135588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f991b821-53db-454a-abff-d93ba7fc7c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627f8390f0d485aa67dbc2613a0dc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:19Z,use_quota=True,user_id='426013363e1643e7941f49702e3d3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Creating volume f991b821-53db-454a-abff-d93ba7fc7c56 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:19 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:19 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 1073741824 Nov 02 10:44:19 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:19 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:19 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Deleted volume successfully. Nov 02 10:44:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d0119fd8-0236-4cb0-a66d-cab6babf76cb tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-683686df-0cbd-47ad-bf1e-0c54abcd02f7-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:20 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 1073741824" returned: 0 in 0.611s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:20 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 Nov 02 10:44:20 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "cinder-quobyte-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:20 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[02401a7d-ae57-4757-a1f6-120984b6e264]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56" returned: 0 in 0.389s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8196715-b011-40c4-bc41-d05bf59ddd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f991b821-53db-454a-abff-d93ba7fc7c56', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138f4470-8bb1-4f0f-9b9b-701d723e392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:20 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Volume volume-f991b821-53db-454a-abff-d93ba7fc7c56 (f991b821-53db-454a-abff-d93ba7fc7c56): created successfully Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138f4470-8bb1-4f0f-9b9b-701d723e392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Flow 'volume_create_manager' (660e5fee-f640-4d73-a889-84594bbbf8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:20 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 Nov 02 10:44:20 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:20 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c3009a8c-b963-4978-aea5-637a3b8e7cf4 tempest-VolumesListAdminTestJSON-1003222023 None] Created volume successfully. Nov 02 10:44:21 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72" returned: 0 in 0.427s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:21 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72 Nov 02 10:44:21 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:21 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72" returned: 0 in 0.314s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-quobyte-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72" released by "delete_volume" :: held 0.811s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Created reservations ['ed05a081-f901-4c83-a4b5-632b257ed883', '952e5c99-8585-4739-befe-bf398f16aeda', 'f1424a1f-dbb9-487d-85c9-d96600701f38', '843ec202-ee2a-4a12-b581-f0a89bf8df86'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:21 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:21 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:21 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.338s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Deleted volume successfully. Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dc98a550-f11c-4b33-b223-4af0360fbd18 tempest-CreateVolumesFromImageTest-1297245508 None] Lock "cinder-0dee2003-c6aa-40c0-8425-d7c1ad0b1f72-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Flow 'volume_create_manager' (39886ded-0f41-466e-8937-588e85016d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de151bd-a701-4977-94ef-2052f0420a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de151bd-a701-4977-94ef-2052f0420a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1974311097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3f3b18-ab8f-4f48-a196-7d90de48adc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627f8390f0d485aa67dbc2613a0dc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:22Z,use_quota=True,user_id='426013363e1643e7941f49702e3d3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d2932f-3543-422e-bc83-8adda2aff16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d2932f-3543-422e-bc83-8adda2aff16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c723cc-bd83-42ea-bb59-a88f7d198e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c723cc-bd83-42ea-bb59-a88f7d198e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3f3b18-ab8f-4f48-a196-7d90de48adc8', 'volume_name': 'volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4647a988-2e19-4a65-9ce1-64332de7afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4647a988-2e19-4a65-9ce1-64332de7afa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd833fcd-2e7d-472d-9edd-9c96bba1013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Volume 4c3f3b18-ab8f-4f48-a196-7d90de48adc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8', 'volume_size': 1} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1974311097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3f3b18-ab8f-4f48-a196-7d90de48adc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627f8390f0d485aa67dbc2613a0dc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:22Z,use_quota=True,user_id='426013363e1643e7941f49702e3d3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Creating volume 4c3f3b18-ab8f-4f48-a196-7d90de48adc8 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:22 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:22 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 1073741824 Nov 02 10:44:22 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:22 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:22 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:23 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:44:23 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 1073741824" returned: 0 in 0.789s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:23 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 Nov 02 10:44:23 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:23 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd833fcd-2e7d-472d-9edd-9c96bba1013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0539f83a-39d4-420e-8f3a-8e8068e07783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:23 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Volume volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 (4c3f3b18-ab8f-4f48-a196-7d90de48adc8): created successfully Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0539f83a-39d4-420e-8f3a-8e8068e07783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Flow 'volume_create_manager' (39886ded-0f41-466e-8937-588e85016d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4e490020-693c-489d-b53a-4968f063dd36 tempest-VolumesListAdminTestJSON-1003222023 None] Created volume successfully. Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Flow 'volume_create_manager' (a795d684-d8af-4a47-8980-2215c22b3d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc2e8f7-412a-4782-976e-8781fe4d69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc2e8f7-412a-4782-976e-8781fe4d69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334217765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7258d7197f4c0b9f889be383645812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:25Z,use_quota=True,user_id='ff7e4da39ff64bb88719845196a62774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f1a563-9d01-4d1b-b3e6-c848e7f850c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f1a563-9d01-4d1b-b3e6-c848e7f850c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60621620-a63f-42c6-ac81-e100ea02a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60621620-a63f-42c6-ac81-e100ea02a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736', 'volume_name': 'volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da1247b-8431-4c24-8c41-5abc53e0d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da1247b-8431-4c24-8c41-5abc53e0d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f3b1bf-c73b-496e-b999-eed9dea29dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Volume 6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736', 'volume_size': 1} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334217765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7258d7197f4c0b9f889be383645812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:25Z,use_quota=True,user_id='ff7e4da39ff64bb88719845196a62774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Creating volume 6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:25 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:25 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 1073741824 Nov 02 10:44:25 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Flow 'volume_create_manager' (d18f9ba9-9730-4128-a757-6438e6a3ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4280963d-b790-4b23-a256-2cda23bfd61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4280963d-b790-4b23-a256-2cda23bfd61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61249270-4a37-4ebd-a2d1-3b23aee25afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02690d671e124a27b9656890ab51bafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:26Z,use_quota=True,user_id='56645da635594708bf42f2964a5e521e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ae3a07-2200-4c43-9b26-9ee4501d7859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ae3a07-2200-4c43-9b26-9ee4501d7859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8844893d-45c3-4229-aced-9994ebb53e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8844893d-45c3-4229-aced-9994ebb53e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61249270-4a37-4ebd-a2d1-3b23aee25afe', 'volume_name': 'volume-61249270-4a37-4ebd-a2d1-3b23aee25afe', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370db021-df69-4fb2-9785-1c109856c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370db021-df69-4fb2-9785-1c109856c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a67e9b-fe0a-4bdd-8d19-dbd727a73c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Volume 61249270-4a37-4ebd-a2d1-3b23aee25afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61249270-4a37-4ebd-a2d1-3b23aee25afe', 'volume_size': 1} Nov 02 10:44:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:26 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 1073741824" returned: 0 in 0.618s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:26 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 Nov 02 10:44:26 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:26 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736" returned: 0 in 0.291s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61249270-4a37-4ebd-a2d1-3b23aee25afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02690d671e124a27b9656890ab51bafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:26Z,use_quota=True,user_id='56645da635594708bf42f2964a5e521e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Creating volume 61249270-4a37-4ebd-a2d1-3b23aee25afe {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:26 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:26 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe 1073741824 Nov 02 10:44:26 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f3b1bf-c73b-496e-b999-eed9dea29dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf07883-a3a4-4226-8330-40c809f328ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Volume volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 (6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736): created successfully Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf07883-a3a4-4226-8330-40c809f328ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Flow 'volume_create_manager' (a795d684-d8af-4a47-8980-2215c22b3d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e5dcc5d7-7233-4ec3-8eec-7100852a7dbd tempest-VolumesTransfersTest-675015245 None] Created volume successfully. Nov 02 10:44:27 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe 1073741824" returned: 0 in 0.959s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:27 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe Nov 02 10:44:27 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Flow 'volume_create_manager' (5e0f649e-2365-4abe-8dc5-04a7391f4da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaf29f8-c843-43c4-9317-6d0d57910a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaf29f8-c843-43c4-9317-6d0d57910a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027732141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360fe37d-7cd6-4fde-baab-3294e7e9b799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e28382e6f1c49bca6b4a674f469827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:28Z,use_quota=True,user_id='2ed351a1243c4b35bf073741f01b1ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c4fd65-a2ce-4f5b-bfcb-4480e2a02095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c4fd65-a2ce-4f5b-bfcb-4480e2a02095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d502a14-3505-4724-9dda-6f48028eef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d502a14-3505-4724-9dda-6f48028eef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360fe37d-7cd6-4fde-baab-3294e7e9b799', 'volume_name': 'volume-360fe37d-7cd6-4fde-baab-3294e7e9b799', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdc4d50-8e95-49cc-b41b-a94dfc3fea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdc4d50-8e95-49cc-b41b-a94dfc3fea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0ce8d3-4774-446c-90c2-f4b42d69e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:28 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Volume 360fe37d-7cd6-4fde-baab-3294e7e9b799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360fe37d-7cd6-4fde-baab-3294e7e9b799', 'volume_size': 1} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:28 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe" returned: 0 in 0.528s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027732141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360fe37d-7cd6-4fde-baab-3294e7e9b799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e28382e6f1c49bca6b4a674f469827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:28Z,use_quota=True,user_id='2ed351a1243c4b35bf073741f01b1ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Creating volume 360fe37d-7cd6-4fde-baab-3294e7e9b799 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:28 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:28 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 1073741824 Nov 02 10:44:28 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a67e9b-fe0a-4bdd-8d19-dbd727a73c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61249270-4a37-4ebd-a2d1-3b23aee25afe', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476130ce-05cf-46ee-91c3-dad4af53fe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:28 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Volume volume-61249270-4a37-4ebd-a2d1-3b23aee25afe (61249270-4a37-4ebd-a2d1-3b23aee25afe): created successfully Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476130ce-05cf-46ee-91c3-dad4af53fe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Flow 'volume_create_manager' (d18f9ba9-9730-4128-a757-6438e6a3ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a01890b4-d587-4b34-aa3e-46a1e6e67da3 tempest-VolumesListAdminTestJSON-965541331 None] Created volume successfully. Nov 02 10:44:28 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 1073741824" returned: 0 in 0.742s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:29 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 Nov 02 10:44:29 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Acquiring lock "cinder-61249270-4a37-4ebd-a2d1-3b23aee25afe-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Lock "cinder-61249270-4a37-4ebd-a2d1-3b23aee25afe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Acquiring lock "cinder-quobyte-61249270-4a37-4ebd-a2d1-3b23aee25afe" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Lock "cinder-quobyte-61249270-4a37-4ebd-a2d1-3b23aee25afe" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "cinder-4c3f3b18-ab8f-4f48-a196-7d90de48adc8-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e44f89-60ad-474a-baee-da8f7f3da4dd]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3bce7a6d-f9d4-4174-a80c-cc940f95b258 tempest-VolumesTransfersTest-1332368133 None] Transfer volume completed successfully. Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-4c3f3b18-ab8f-4f48-a196-7d90de48adc8-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "cinder-quobyte-4c3f3b18-ab8f-4f48-a196-7d90de48adc8" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:29 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799" returned: 0 in 0.519s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:29 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe Nov 02 10:44:29 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0ce8d3-4774-446c-90c2-f4b42d69e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360fe37d-7cd6-4fde-baab-3294e7e9b799', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e49755d-2fed-42cd-ab38-bbb39080c775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-quobyte-4c3f3b18-ab8f-4f48-a196-7d90de48adc8" acquired by "delete_volume" :: waited 0.069s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:29 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Volume volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 (360fe37d-7cd6-4fde-baab-3294e7e9b799): created successfully Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e49755d-2fed-42cd-ab38-bbb39080c775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Flow 'volume_create_manager' (5e0f649e-2365-4abe-8dc5-04a7391f4da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c864a9-b2bf-4568-9efe-7027924a79de]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-168cf784-ef7e-4806-8ef1-e31aee555c20 tempest-ProjectReaderTests-530176029 None] Created volume successfully. Nov 02 10:44:29 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 Nov 02 10:44:29 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:30 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe" returned: 0 in 0.840s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:30 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe Nov 02 10:44:30 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Acquiring lock "cinder-360fe37d-7cd6-4fde-baab-3294e7e9b799-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Acquiring lock "cinder-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Lock "cinder-360fe37d-7cd6-4fde-baab-3294e7e9b799-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Lock "cinder-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Acquiring lock "cinder-quobyte-360fe37d-7cd6-4fde-baab-3294e7e9b799" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:30 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Lock "cinder-quobyte-360fe37d-7cd6-4fde-baab-3294e7e9b799" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Acquiring lock "cinder-quobyte-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8" returned: 0 in 0.957s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d9f457-3695-48cb-9f64-5b399a375013]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:30 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8 Nov 02 10:44:30 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Lock "cinder-quobyte-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736" acquired by "delete_volume" :: waited 0.075s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08216e2-24b6-443a-aecc-4a82b8800763]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:30 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-61249270-4a37-4ebd-a2d1-3b23aee25afe" returned: 0 in 0.668s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:30 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 Nov 02 10:44:30 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:30 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 Nov 02 10:44:30 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Lock "cinder-quobyte-61249270-4a37-4ebd-a2d1-3b23aee25afe" released by "delete_volume" :: held 1.663s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:31 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-4c3f3b18-ab8f-4f48-a196-7d90de48adc8" returned: 0 in 0.431s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Created reservations ['d51cea8f-78a3-45af-a36a-0321f494b2cb', '10211dc1-6ad1-4c43-8420-8a704c2821e5', '193be78a-8947-4da9-b3bb-d98ccfd30c09', '68684714-c04c-4e3e-94cc-8b5db47fb149'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-quobyte-4c3f3b18-ab8f-4f48-a196-7d90de48adc8" released by "delete_volume" :: held 1.493s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Created reservations ['e9b07426-3f32-4811-9713-99882dd6cbc8', '6a2c0e3d-78fb-47d4-ba2c-d9abff21c36d', '5150623a-c5e7-4cbd-b105-bc0bb240fe80', '0f5992b6-1832-459d-b3c0-9ac2d8f47178'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:31 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:31 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:31 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:31 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:31 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736" returned: 0 in 0.790s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:31 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799" returned: 0 in 0.957s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:31 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736 Nov 02 10:44:31 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:31 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799 Nov 02 10:44:31 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:31 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.459s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:31 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Deleted volume successfully. Nov 02 10:44:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d632d7df-309d-4493-ae50-35dbd3689f34 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-4c3f3b18-ab8f-4f48-a196-7d90de48adc8-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "cinder-f991b821-53db-454a-abff-d93ba7fc7c56-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-f991b821-53db-454a-abff-d93ba7fc7c56-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:32 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-360fe37d-7cd6-4fde-baab-3294e7e9b799" returned: 0 in 0.470s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:32 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.848s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Lock "cinder-quobyte-360fe37d-7cd6-4fde-baab-3294e7e9b799" released by "delete_volume" :: held 1.555s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Deleted volume successfully. Nov 02 10:44:32 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736" returned: 0 in 0.659s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Lock "cinder-quobyte-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736" released by "delete_volume" :: held 1.555s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "cinder-quobyte-f991b821-53db-454a-abff-d93ba7fc7c56" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f60d1c8a-80d1-4a78-bac8-29e02d3a6dc5 tempest-VolumesListAdminTestJSON-965541331 None] Lock "cinder-61249270-4a37-4ebd-a2d1-3b23aee25afe-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-quobyte-f991b821-53db-454a-abff-d93ba7fc7c56" acquired by "delete_volume" :: waited 0.046s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1277a9a5-07b9-40ab-b7b2-db3ecc846928]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Created reservations ['0c42435f-c70b-473c-a6fa-c008dec37c88', '05183855-9da3-4aa8-b71e-8183293bf138', 'a56113f4-d2f3-4e41-8930-0f02f2312082', 'a472475e-d52a-433b-ab50-84eaea97cc3b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Created reservations ['12b75faa-028c-45a1-9415-fccf3f5f20b7', '93302fb4-a460-4e05-9aae-0a9e78467438', '5d2243a5-a322-4540-8580-9c4065ffa7ba', 'f70d2229-8bbe-448b-bc14-656e49e0df9b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:32 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 Nov 02 10:44:32 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:32 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:32 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:32 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:32 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:33 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.459s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Deleted volume successfully. Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b571b936-f4a8-42f5-a121-d537ce8c5683 tempest-ProjectReaderTests-530176029 None] Lock "cinder-360fe37d-7cd6-4fde-baab-3294e7e9b799-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:33 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.510s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Deleted volume successfully. Nov 02 10:44:33 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56" returned: 0 in 0.847s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f92051a8-b1f3-4a8e-bdf7-6324c358ef97 tempest-VolumesTransfersTest-248265415 None] Lock "cinder-6cf91f7d-c0ea-4ab0-859e-9e5e5ca8e736-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:33 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56 Nov 02 10:44:33 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:33 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f991b821-53db-454a-abff-d93ba7fc7c56" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-quobyte-f991b821-53db-454a-abff-d93ba7fc7c56" released by "delete_volume" :: held 1.316s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Created reservations ['f97d1fbc-0546-4a85-bb48-784230bc180e', '90b94198-99e1-4cbb-92cc-05135015a7d1', '2c7293f0-e483-4e8a-9666-2c10c5afcf02', '06a1491a-9678-47b8-a056-d87b4af53c0c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:34 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:34 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Flow 'volume_create_manager' (2f04f233-1903-490b-94dc-07653112476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da29f4e-9e75-4256-8fad-f3044052aaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da29f4e-9e75-4256-8fad-f3044052aaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135598489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80013f3-f9e5-4a5f-b884-5b7712834614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e28382e6f1c49bca6b4a674f469827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:34Z,use_quota=True,user_id='2ed351a1243c4b35bf073741f01b1ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c5c4d-58ea-4f05-b26e-491920c97f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c5c4d-58ea-4f05-b26e-491920c97f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e16eb3a-1359-4363-8dcc-213e5810f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e16eb3a-1359-4363-8dcc-213e5810f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80013f3-f9e5-4a5f-b884-5b7712834614', 'volume_name': 'volume-b80013f3-f9e5-4a5f-b884-5b7712834614', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd687f3-3812-4945-af3f-d458bd945072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd687f3-3812-4945-af3f-d458bd945072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf919c2-0d00-4cdc-a900-864f8428ed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Volume b80013f3-f9e5-4a5f-b884-5b7712834614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80013f3-f9e5-4a5f-b884-5b7712834614', 'volume_size': 1} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135598489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80013f3-f9e5-4a5f-b884-5b7712834614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e28382e6f1c49bca6b4a674f469827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:34Z,use_quota=True,user_id='2ed351a1243c4b35bf073741f01b1ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Creating volume b80013f3-f9e5-4a5f-b884-5b7712834614 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:34 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.455s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:34 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 1073741824 Nov 02 10:44:34 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Deleted volume successfully. Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Flow 'volume_create_manager' (06e8ea9f-963d-4964-b427-872e0d0c3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f458d1a-ca2c-413b-a4b8-6f0fc855c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2abfefa4-808b-4f65-b8ba-9a8b01e6bf1e tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-f991b821-53db-454a-abff-d93ba7fc7c56-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f458d1a-ca2c-413b-a4b8-6f0fc855c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-285998865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecba6069-e71f-481e-bea4-70e836d8448b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7258d7197f4c0b9f889be383645812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:34Z,use_quota=True,user_id='ff7e4da39ff64bb88719845196a62774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0721428b-2ada-470b-83da-6d5e45635ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0721428b-2ada-470b-83da-6d5e45635ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d75a11-228f-401f-990d-365fdec662ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d75a11-228f-401f-990d-365fdec662ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecba6069-e71f-481e-bea4-70e836d8448b', 'volume_name': 'volume-ecba6069-e71f-481e-bea4-70e836d8448b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe74d3a-e298-41dd-8e77-c3d4219c25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe74d3a-e298-41dd-8e77-c3d4219c25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df1fba0-c360-4b25-92e2-961a736ab3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:34 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Volume ecba6069-e71f-481e-bea4-70e836d8448b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecba6069-e71f-481e-bea4-70e836d8448b', 'volume_size': 1} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "cinder-49b2be65-9be3-4f5e-b95a-0b854d7174de-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-49b2be65-9be3-4f5e-b95a-0b854d7174de-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:35 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 1073741824" returned: 0 in 0.598s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "cinder-quobyte-49b2be65-9be3-4f5e-b95a-0b854d7174de" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-quobyte-49b2be65-9be3-4f5e-b95a-0b854d7174de" acquired by "delete_volume" :: waited 0.054s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:35 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 Nov 02 10:44:35 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[2416c35f-d5b8-485d-8d90-a9f2aa02c2e9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:35 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de Nov 02 10:44:35 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:35 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614" returned: 0 in 0.345s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-285998865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecba6069-e71f-481e-bea4-70e836d8448b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7258d7197f4c0b9f889be383645812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:34Z,use_quota=True,user_id='ff7e4da39ff64bb88719845196a62774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Creating volume ecba6069-e71f-481e-bea4-70e836d8448b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:35 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf919c2-0d00-4cdc-a900-864f8428ed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80013f3-f9e5-4a5f-b884-5b7712834614', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf6ab6d-901a-49ce-b4fe-384de287f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:35 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b 1073741824 Nov 02 10:44:35 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:35 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Volume volume-b80013f3-f9e5-4a5f-b884-5b7712834614 (b80013f3-f9e5-4a5f-b884-5b7712834614): created successfully Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf6ab6d-901a-49ce-b4fe-384de287f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Flow 'volume_create_manager' (2f04f233-1903-490b-94dc-07653112476c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-521d6983-5dea-4329-92f0-f5b4f33184eb tempest-ProjectReaderTests-530176029 None] Created volume successfully. Nov 02 10:44:35 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de" returned: 0 in 0.461s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:35 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de Nov 02 10:44:35 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:35 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b 1073741824" returned: 0 in 0.449s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:35 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b2be65-9be3-4f5e-b95a-0b854d7174de" returned: 0 in 0.297s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-quobyte-49b2be65-9be3-4f5e-b95a-0b854d7174de" released by "delete_volume" :: held 0.822s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:36 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b Nov 02 10:44:36 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Created reservations ['fb04c9c7-68a3-4256-8598-a650295b00ec', 'db8ddb03-32ef-43b2-aa4c-9c3e8ffbe2b8', '464cf9c0-7d9e-4955-983b-709b7d5e509d', 'fcf82b1e-11cd-4274-88fd-94f50d46a525'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:36 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:36 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Acquiring lock "cinder-b80013f3-f9e5-4a5f-b884-5b7712834614-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Lock "cinder-b80013f3-f9e5-4a5f-b884-5b7712834614-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Acquiring lock "cinder-quobyte-b80013f3-f9e5-4a5f-b884-5b7712834614" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Lock "cinder-quobyte-b80013f3-f9e5-4a5f-b884-5b7712834614" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:36 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b" returned: 0 in 0.539s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[73993cb8-bc59-4a38-a39d-4a02c4b76ae8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df1fba0-c360-4b25-92e2-961a736ab3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecba6069-e71f-481e-bea4-70e836d8448b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9217dccb-d6f2-4753-8299-2fd093fa231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:36 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Volume volume-ecba6069-e71f-481e-bea4-70e836d8448b (ecba6069-e71f-481e-bea4-70e836d8448b): created successfully Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9217dccb-d6f2-4753-8299-2fd093fa231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Flow 'volume_create_manager' (06e8ea9f-963d-4964-b427-872e0d0c3765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e3e65642-5cc2-427d-a0ed-34206d3009d9 tempest-VolumesTransfersTest-675015245 None] Created volume successfully. Nov 02 10:44:36 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 Nov 02 10:44:36 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:36 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.588s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Deleted volume successfully. Nov 02 10:44:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2e1b72cb-4919-40b6-b990-501c9dbc08e6 tempest-VolumesListAdminTestJSON-1003222023 None] Lock "cinder-49b2be65-9be3-4f5e-b95a-0b854d7174de-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:37 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614" returned: 0 in 0.492s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:37 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614 Nov 02 10:44:37 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:37 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b80013f3-f9e5-4a5f-b884-5b7712834614" returned: 0 in 0.253s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Lock "cinder-quobyte-b80013f3-f9e5-4a5f-b884-5b7712834614" released by "delete_volume" :: held 0.819s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Created reservations ['103fa662-3052-467c-b9c7-4c7b01f54887', 'fcb7158d-41b0-482f-8751-c88f74c4091f', '0b3176a6-3157-4e0c-b4cd-ddad38e140b5', 'fcaff4fb-9130-4ee9-8832-392c0cf0e58c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:37 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:37 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Acquiring lock "cinder-ecba6069-e71f-481e-bea4-70e836d8448b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Lock "cinder-ecba6069-e71f-481e-bea4-70e836d8448b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:38 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.512s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Deleted volume successfully. Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Acquiring lock "cinder-quobyte-ecba6069-e71f-481e-bea4-70e836d8448b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e611fb5d-0003-4609-8241-f0ea8d556a99 tempest-ProjectReaderTests-530176029 None] Lock "cinder-b80013f3-f9e5-4a5f-b884-5b7712834614-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Lock "cinder-quobyte-ecba6069-e71f-481e-bea4-70e836d8448b" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db2a3bf-ce8f-4533-adb0-9e0b45403111]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:38 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b Nov 02 10:44:38 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:38 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b" returned: 0 in 0.614s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:38 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b Nov 02 10:44:38 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:39 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ecba6069-e71f-481e-bea4-70e836d8448b" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Lock "cinder-quobyte-ecba6069-e71f-481e-bea4-70e836d8448b" released by "delete_volume" :: held 1.122s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Created reservations ['26a35dd8-aa31-4c7b-8272-1cf64ca0ea18', '4e8d03a3-c273-43ad-a533-806068fb3a48', '15ebcb31-2725-409e-ab51-3baf866d5d37', '56f057fd-7fd6-4695-be6b-e2acdca7aabe'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:39 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:39 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:39 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.337s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Deleted volume successfully. Nov 02 10:44:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3770d93-47de-4c14-9680-5d116b89b34b tempest-VolumesTransfersTest-248265415 None] Lock "cinder-ecba6069-e71f-481e-bea4-70e836d8448b-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Flow 'volume_create_manager' (32284543-2a87-4179-a0c3-5f994834d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f608790-5477-4168-8f7f-f4ac9688fed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f608790-5477-4168-8f7f-f4ac9688fed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-139279133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca2a922-50e5-40ac-999b-5b9284c52179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4b7821f61f42eeaa334159d404f58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:45Z,use_quota=True,user_id='bdaf0d69338f475cafc1935dc3c01d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f8155c-df88-4b17-807b-d4f4808f5903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f8155c-df88-4b17-807b-d4f4808f5903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe16989a-bc4b-4f41-b41c-b68d242458d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe16989a-bc4b-4f41-b41c-b68d242458d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca2a922-50e5-40ac-999b-5b9284c52179', 'volume_name': 'volume-2ca2a922-50e5-40ac-999b-5b9284c52179', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4dfd14-332a-41e9-a294-3930bd9c8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4dfd14-332a-41e9-a294-3930bd9c8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2717b6-9aa9-4b5e-8dcd-901e45b68af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:45 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Volume 2ca2a922-50e5-40ac-999b-5b9284c52179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca2a922-50e5-40ac-999b-5b9284c52179', 'volume_size': 1} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-139279133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca2a922-50e5-40ac-999b-5b9284c52179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4b7821f61f42eeaa334159d404f58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:45Z,use_quota=True,user_id='bdaf0d69338f475cafc1935dc3c01d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Creating volume 2ca2a922-50e5-40ac-999b-5b9284c52179 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:45 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:45 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 1073741824 Nov 02 10:44:45 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:45 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 1073741824" returned: 0 in 0.553s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:45 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 Nov 02 10:44:45 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:46 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2717b6-9aa9-4b5e-8dcd-901e45b68af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca2a922-50e5-40ac-999b-5b9284c52179', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d770a8ae-1109-4285-8747-ae4219ba22c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:46 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Volume volume-2ca2a922-50e5-40ac-999b-5b9284c52179 (2ca2a922-50e5-40ac-999b-5b9284c52179): created successfully Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d770a8ae-1109-4285-8747-ae4219ba22c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Flow 'volume_create_manager' (32284543-2a87-4179-a0c3-5f994834d114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f93ed5d9-dcfa-424b-ba87-548c51b6a6c3 tempest-AbsoluteLimitsTests-1066027936 None] Created volume successfully. Nov 02 10:44:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Acquiring lock "cinder-2ca2a922-50e5-40ac-999b-5b9284c52179-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Lock "cinder-2ca2a922-50e5-40ac-999b-5b9284c52179-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Acquiring lock "cinder-quobyte-2ca2a922-50e5-40ac-999b-5b9284c52179" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Lock "cinder-quobyte-2ca2a922-50e5-40ac-999b-5b9284c52179" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdc5ee3-1e84-4776-a80f-2f62318a9b2b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:47 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 Nov 02 10:44:47 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:48 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179" returned: 0 in 0.490s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:48 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179 Nov 02 10:44:48 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:48 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2ca2a922-50e5-40ac-999b-5b9284c52179" returned: 0 in 0.293s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Lock "cinder-quobyte-2ca2a922-50e5-40ac-999b-5b9284c52179" released by "delete_volume" :: held 0.842s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Created reservations ['6f36102d-4d63-4b51-990c-e3dc05f15fac', '3182dae6-f950-475b-8d3d-c92547efcf3d', '2d8428a9-7290-4425-b012-6afaeb5809fc', '308cf5e1-47ac-457e-b229-1e8210c2228d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:48 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:44:48 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:49 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:49 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Deleted volume successfully. Nov 02 10:44:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bcd1ab93-f0b8-4def-a024-f9931addc819 tempest-AbsoluteLimitsTests-1066027936 None] Lock "cinder-2ca2a922-50e5-40ac-999b-5b9284c52179-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Flow 'volume_create_manager' (7039687f-6f66-4ee6-a7e0-4504a09878ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a515673b-99b8-4b0f-a5de-f5ecfa6e8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a515673b-99b8-4b0f-a5de-f5ecfa6e8c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-289673090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6855fb5-9a2a-4876-abb5-fb04929416e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf39309f6214b0a8769c81e25e1cbd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:54Z,use_quota=True,user_id='06181bb3413f46a0824266187f1f4fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a74d5a-defc-44af-a87b-1737d08edf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a74d5a-defc-44af-a87b-1737d08edf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee11e8e8-2363-4fec-b685-ce73969b503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee11e8e8-2363-4fec-b685-ce73969b503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6855fb5-9a2a-4876-abb5-fb04929416e1', 'volume_name': 'volume-d6855fb5-9a2a-4876-abb5-fb04929416e1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8c36e6-fa73-4ab4-b8f2-5126e52b6e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8c36e6-fa73-4ab4-b8f2-5126e52b6e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8381c8-fa6a-4d02-9898-24f4d94c5d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Volume d6855fb5-9a2a-4876-abb5-fb04929416e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6855fb5-9a2a-4876-abb5-fb04929416e1', 'volume_size': 1} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-289673090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6855fb5-9a2a-4876-abb5-fb04929416e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf39309f6214b0a8769c81e25e1cbd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:54Z,use_quota=True,user_id='06181bb3413f46a0824266187f1f4fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Creating volume d6855fb5-9a2a-4876-abb5-fb04929416e1 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:54 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:54 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 1073741824 Nov 02 10:44:54 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:54 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 1073741824" returned: 0 in 0.528s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:54 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 Nov 02 10:44:54 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:55 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1" returned: 0 in 0.304s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8381c8-fa6a-4d02-9898-24f4d94c5d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6855fb5-9a2a-4876-abb5-fb04929416e1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab97680-78ee-47b4-8b28-b600ac309d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:55 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Volume volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 (d6855fb5-9a2a-4876-abb5-fb04929416e1): created successfully Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab97680-78ee-47b4-8b28-b600ac309d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Flow 'volume_create_manager' (7039687f-6f66-4ee6-a7e0-4504a09878ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c2d14a7e-a671-40ae-b8bc-31417b6c4dc1 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Created volume successfully. Nov 02 10:44:56 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Flow 'volume_create_manager' (54798b24-c5fd-4d2c-bacb-843b12d012ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1612ab-79b3-46cc-a774-64c30d4a1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1612ab-79b3-46cc-a774-64c30d4a1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1894689151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc3bd46-1642-4009-a9d1-25795cb59b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c05abb421d84e469a009a73f90abcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:57Z,use_quota=True,user_id='d3d19db84a664774a1c2b832606fbe46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce95c8a-9777-4c4b-9676-58f06e155af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce95c8a-9777-4c4b-9676-58f06e155af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7bdf44-cc25-44d6-a5a3-93be3149472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7bdf44-cc25-44d6-a5a3-93be3149472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc3bd46-1642-4009-a9d1-25795cb59b96', 'volume_name': 'volume-6cc3bd46-1642-4009-a9d1-25795cb59b96', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b42612-5733-4f63-ba5d-9829cfbf2820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b42612-5733-4f63-ba5d-9829cfbf2820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c211896b-e124-4531-a397-884a8f5fd65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Volume 6cc3bd46-1642-4009-a9d1-25795cb59b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc3bd46-1642-4009-a9d1-25795cb59b96', 'volume_size': 1} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1894689151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc3bd46-1642-4009-a9d1-25795cb59b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c05abb421d84e469a009a73f90abcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:57Z,use_quota=True,user_id='d3d19db84a664774a1c2b832606fbe46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Creating volume 6cc3bd46-1642-4009-a9d1-25795cb59b96 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:57 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:57 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 1073741824 Nov 02 10:44:57 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3ad99956-3842-45e2-b279-40b6484854c0 req-adb6ce07-c0b8-455b-ba6f-ce587e2c249a tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:57 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 1073741824" returned: 0 in 0.483s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:57 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 Nov 02 10:44:57 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:57 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3ad99956-3842-45e2-b279-40b6484854c0 req-adb6ce07-c0b8-455b-ba6f-ce587e2c249a tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.688s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c211896b-e124-4531-a397-884a8f5fd65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc3bd46-1642-4009-a9d1-25795cb59b96', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5330538-4e08-4579-9e16-4e3ae71bc13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3ad99956-3842-45e2-b279-40b6484854c0 req-adb6ce07-c0b8-455b-ba6f-ce587e2c249a tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Volume volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 (6cc3bd46-1642-4009-a9d1-25795cb59b96): created successfully Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5330538-4e08-4579-9e16-4e3ae71bc13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Flow 'volume_create_manager' (54798b24-c5fd-4d2c-bacb-843b12d012ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dd2e6b8d-957d-4eb0-a383-d0b6b1c365b4 tempest-VolumesTransfersV355Test-1936085051 None] Created volume successfully. Nov 02 10:44:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-3ad99956-3842-45e2-b279-40b6484854c0 req-adb6ce07-c0b8-455b-ba6f-ce587e2c249a tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-d6855fb5-9a2a-4876-abb5-fb04929416e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c583a06e-220d-4d44-9716-32f8cb22bea4', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:44:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-3ad99956-3842-45e2-b279-40b6484854c0 req-adb6ce07-c0b8-455b-ba6f-ce587e2c249a tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] attachment_update completed successfully. Nov 02 10:44:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-89e30476-1a6d-4951-91cc-0c615a431206 tempest-VolumesTransfersV355Test-883494218 None] Transfer volume completed successfully. Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Acquiring lock "cinder-6cc3bd46-1642-4009-a9d1-25795cb59b96-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-6cc3bd46-1642-4009-a9d1-25795cb59b96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Acquiring lock "cinder-quobyte-6cc3bd46-1642-4009-a9d1-25795cb59b96" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-quobyte-6cc3bd46-1642-4009-a9d1-25795cb59b96" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb95c124-a308-4e65-b11a-f829d685849b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:00 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 Nov 02 10:45:00 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-2796dfda-c770-44f1-97a5-7fbc7d7c268c req-37b07646-8a56-40c2-b52c-0186235d3bf8 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Terminate volume connection completed successfully. Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-2796dfda-c770-44f1-97a5-7fbc7d7c268c req-37b07646-8a56-40c2-b52c-0186235d3bf8 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Deleting attachment c583a06e-220d-4d44-9716-32f8cb22bea4. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Flow 'volume_create_manager' (7912504c-8f86-456e-9dcf-c8b9880e233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0cb1ba-3d34-4adc-9249-60697f2e8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0cb1ba-3d34-4adc-9249-60697f2e8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877964287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3638129-b4aa-48e2-a1b9-c9f2fdce85c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52be7b4207f64c0a8498465ca37454b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:01Z,use_quota=True,user_id='a0b20014140347389f50288d6fa522d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af097444-03d2-4094-8d67-edbeee673e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af097444-03d2-4094-8d67-edbeee673e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9260ba9-5213-425d-885a-be9246e48988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:01 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9260ba9-5213-425d-885a-be9246e48988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3638129-b4aa-48e2-a1b9-c9f2fdce85c7', 'volume_name': 'volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09747aa4-7883-4486-98c2-f0335ea2510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09747aa4-7883-4486-98c2-f0335ea2510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3329466a-6724-453d-b9d8-9c6249c58bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Volume f3638129-b4aa-48e2-a1b9-c9f2fdce85c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7', 'volume_size': 1} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877964287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3638129-b4aa-48e2-a1b9-c9f2fdce85c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52be7b4207f64c0a8498465ca37454b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:01Z,use_quota=True,user_id='a0b20014140347389f50288d6fa522d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Creating volume f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:01 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96" returned: 0 in 0.527s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 1073741824 Nov 02 10:45:01 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96 Nov 02 10:45:01 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6cc3bd46-1642-4009-a9d1-25795cb59b96" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-quobyte-6cc3bd46-1642-4009-a9d1-25795cb59b96" released by "delete_volume" :: held 0.853s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Created reservations ['a5174ed2-05f0-4c48-a92b-7a5a08a707f1', '442af925-a6d1-40e3-bdc6-609ca5803484', '6d603280-1e75-4432-958e-8867c0eff673', '2748b260-601b-4e07-a2c0-4ffba17f5475'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:45:01 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Acquiring lock "cinder-d6855fb5-9a2a-4876-abb5-fb04929416e1-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "cinder-d6855fb5-9a2a-4876-abb5-fb04929416e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:01 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 1073741824" returned: 0 in 0.543s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Acquiring lock "cinder-quobyte-d6855fb5-9a2a-4876-abb5-fb04929416e1" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "cinder-quobyte-d6855fb5-9a2a-4876-abb5-fb04929416e1" acquired by "delete_volume" :: waited 0.039s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:01 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:45:01 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe759de8-35d3-4860-b56a-46d658ce9f37]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:01 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 Nov 02 10:45:01 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Deleted volume successfully. Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-82028b20-3655-4a52-8f27-68535c33b815 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-6cc3bd46-1642-4009-a9d1-25795cb59b96-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:01 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3329466a-6724-453d-b9d8-9c6249c58bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfe0100-f5bf-4d6b-87d2-71d66dd0cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Volume volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 (f3638129-b4aa-48e2-a1b9-c9f2fdce85c7): created successfully Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfe0100-f5bf-4d6b-87d2-71d66dd0cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Flow 'volume_create_manager' (7912504c-8f86-456e-9dcf-c8b9880e233e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-258c526a-71ed-44e3-bcb2-ef7ea71b9ddb tempest-VolumesActionsTest-1431641593 None] Created volume successfully. Nov 02 10:45:02 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:02 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1 Nov 02 10:45:02 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Flow 'volume_create_manager' (efad4fd2-b397-4a76-9cc6-9b3f0d210de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ba9b5c-8ea1-4d43-9fca-3c9a430b3408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ba9b5c-8ea1-4d43-9fca-3c9a430b3408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1677284851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aae13f4-4d07-4388-9a1c-b2bae8e91200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c05abb421d84e469a009a73f90abcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:02Z,use_quota=True,user_id='d3d19db84a664774a1c2b832606fbe46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad834417-88ee-48f2-be88-d12eab54f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad834417-88ee-48f2-be88-d12eab54f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdbcf6-920e-46ea-8099-8360f3615ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdbcf6-920e-46ea-8099-8360f3615ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aae13f4-4d07-4388-9a1c-b2bae8e91200', 'volume_name': 'volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2213e0d4-5022-4e8a-a2f5-03a1a9f5c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2213e0d4-5022-4e8a-a2f5-03a1a9f5c981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810dbbb6-d8c3-41a1-8c87-15da254f49be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Volume 2aae13f4-4d07-4388-9a1c-b2bae8e91200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200', 'volume_size': 1} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1677284851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aae13f4-4d07-4388-9a1c-b2bae8e91200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c05abb421d84e469a009a73f90abcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:02Z,use_quota=True,user_id='d3d19db84a664774a1c2b832606fbe46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Creating volume 2aae13f4-4d07-4388-9a1c-b2bae8e91200 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:02 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:02 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 1073741824 Nov 02 10:45:02 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:02 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d6855fb5-9a2a-4876-abb5-fb04929416e1" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "cinder-quobyte-d6855fb5-9a2a-4876-abb5-fb04929416e1" released by "delete_volume" :: held 0.785s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Created reservations ['adea75ad-5c4c-4bc4-ae02-0ad22373a63c', '0cea7522-1290-4e6e-bc12-7071ebc8378e', '71167617-4a6e-44be-9e40-d0c2a41f40c6', '028d4ce9-44c8-4aac-ba48-3bec949aa299'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:02 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:45:02 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:02 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:02 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 1073741824" returned: 0 in 0.498s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Deleted volume successfully. Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7e129c1a-9425-4f5c-948d-936f604dc841 tempest-TestServerVolumeAttachScenarioOldVersion-183723970 None] Lock "cinder-d6855fb5-9a2a-4876-abb5-fb04929416e1-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:02 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 Nov 02 10:45:02 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:03 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200" returned: 0 in 0.360s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810dbbb6-d8c3-41a1-8c87-15da254f49be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2c2c2c-b01f-4285-b59a-484bc7a9dfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Volume volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 (2aae13f4-4d07-4388-9a1c-b2bae8e91200): created successfully Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2c2c2c-b01f-4285-b59a-484bc7a9dfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Flow 'volume_create_manager' (efad4fd2-b397-4a76-9cc6-9b3f0d210de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-33f8e6f8-0f1b-4958-a1e0-1740f0d49d9f tempest-VolumesTransfersV355Test-1936085051 None] Created volume successfully. Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Acquiring lock "cinder-2aae13f4-4d07-4388-9a1c-b2bae8e91200-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-2aae13f4-4d07-4388-9a1c-b2bae8e91200-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=183,cinder:SELECT=126,cinder:INSERT=39,cinder:DELETE=15 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=124,cinder:UPDATE=185,cinder:DELETE=19,cinder:INSERT=43 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Acquiring lock "cinder-quobyte-2aae13f4-4d07-4388-9a1c-b2bae8e91200" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-quobyte-2aae13f4-4d07-4388-9a1c-b2bae8e91200" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[46739564-0a5c-4948-a896-e55d395fa33a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:05 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 Nov 02 10:45:05 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:05 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200" returned: 0 in 0.464s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:05 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200 Nov 02 10:45:05 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:05 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2aae13f4-4d07-4388-9a1c-b2bae8e91200" returned: 0 in 0.330s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-quobyte-2aae13f4-4d07-4388-9a1c-b2bae8e91200" released by "delete_volume" :: held 0.860s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:05 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Created reservations ['2cb1e78e-e9b9-497f-b840-1ca9c89732d2', 'aa19efbb-c5ce-4278-be5c-e5cacb1403eb', '7abefe9b-dbc1-4e92-8bb4-4ae96fa533bd', '8feb2244-27b6-4d5f-9be6-cb854aceb560'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:06 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:45:06 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:06 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Deleted volume successfully. Nov 02 10:45:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbc179b7-f46d-42ba-8319-fc608f53a429 tempest-VolumesTransfersV355Test-702321431 None] Lock "cinder-2aae13f4-4d07-4388-9a1c-b2bae8e91200-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa175d92-4edd-4aad-af7a-72d57e9a9585 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" by "attach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa175d92-4edd-4aad-af7a-72d57e9a9585 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" acquired by "attach_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-aa175d92-4edd-4aad-af7a-72d57e9a9585 tempest-VolumesActionsTest-1431641593 None] Attaching volume f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 to instance 2a845338-a6d6-4d2e-80fa-20821897889f at mountpoint /dev/vdb on host None. Nov 02 10:45:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-aa175d92-4edd-4aad-af7a-72d57e9a9585 tempest-VolumesActionsTest-1431641593 None] Attach volume completed successfully. Nov 02 10:45:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa175d92-4edd-4aad-af7a-72d57e9a9585 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" released by "attach_volume" :: held 0.113s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d27a0628-83fb-467f-afaf-e07bb2055393 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-detach_volume" by "detach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d27a0628-83fb-467f-afaf-e07bb2055393 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d27a0628-83fb-467f-afaf-e07bb2055393 tempest-VolumesActionsTest-1431641593 None] Detaching volume f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 from instance 2a845338-a6d6-4d2e-80fa-20821897889f. Nov 02 10:45:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d27a0628-83fb-467f-afaf-e07bb2055393 tempest-VolumesActionsTest-1431641593 None] Detach volume completed successfully. Nov 02 10:45:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d27a0628-83fb-467f-afaf-e07bb2055393 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Flow 'volume_create_manager' (71f6777c-d18f-4ae2-be2c-3e57e34b4acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa70161-b2d9-42e2-a5fa-628ca689d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa70161-b2d9-42e2-a5fa-628ca689d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1967001692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4b8b22-5dee-4c21-8e30-8a51c9e01d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0c3e188b0941cd819ee35ec21397d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:16Z,use_quota=True,user_id='48ef787b7fb542c78eff037f45b963a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc3a406-4804-4158-aa70-a48cde4e50f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc3a406-4804-4158-aa70-a48cde4e50f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90979ae9-baf7-4428-9e72-fbabc99555ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90979ae9-baf7-4428-9e72-fbabc99555ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'volume_name': 'volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e5a035-4863-44b3-aa83-907b4635667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e5a035-4863-44b3-aa83-907b4635667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126171b1-1110-4bc2-9503-2d43e60af31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:16 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Volume da4b8b22-5dee-4c21-8e30-8a51c9e01d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'volume_size': 1} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1967001692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4b8b22-5dee-4c21-8e30-8a51c9e01d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0c3e188b0941cd819ee35ec21397d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:16Z,use_quota=True,user_id='48ef787b7fb542c78eff037f45b963a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Creating volume da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:16 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:45:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:16 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 1073741824 Nov 02 10:45:16 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:17 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 1073741824" returned: 0 in 0.486s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:17 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 Nov 02 10:45:17 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:17 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" returned: 0 in 0.305s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126171b1-1110-4bc2-9503-2d43e60af31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bdc974-0d7f-4a6e-82df-a22521253e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:17 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Volume volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 (da4b8b22-5dee-4c21-8e30-8a51c9e01d32): created successfully Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bdc974-0d7f-4a6e-82df-a22521253e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Flow 'volume_create_manager' (71f6777c-d18f-4ae2-be2c-3e57e34b4acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9c326502-eeb0-4160-b6c2-136df2b95fa8 tempest-VolumesCloneTest-1211686127 None] Created volume successfully. Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Flow 'volume_create_manager' (8aa7fa99-b66e-419e-8815-e6d4494ab371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66088484-eaa1-4dab-96e6-c84b7eff12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66088484-eaa1-4dab-96e6-c84b7eff12fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-52896173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa4d89b-5639-40d5-a4c8-7b594e21874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0c3e188b0941cd819ee35ec21397d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=da4b8b22-5dee-4c21-8e30-8a51c9e01d32,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:19Z,use_quota=True,user_id='48ef787b7fb542c78eff037f45b963a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060610b4-ac87-4985-9e62-08a033eb8bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060610b4-ac87-4985-9e62-08a033eb8bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fa8db4-dcd5-4980-b99a-10c69434f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fa8db4-dcd5-4980-b99a-10c69434f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'daa4d89b-5639-40d5-a4c8-7b594e21874b', 'volume_name': 'volume-daa4d89b-5639-40d5-a4c8-7b594e21874b', 'volume_size': 2, 'source_volid': 'da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'source_volstatus': 'available'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8b6cbd-4fb3-46a8-a10d-99527691bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8b6cbd-4fb3-46a8-a10d-99527691bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94014d85-ff66-4fea-9792-07bf98d54b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:19 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Volume daa4d89b-5639-40d5-a4c8-7b594e21874b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-daa4d89b-5639-40d5-a4c8-7b594e21874b', 'volume_size': 2, 'source_volid': 'da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'source_volstatus': 'available'} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:19 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Cloning volume da4b8b22-5dee-4c21-8e30-8a51c9e01d32 to volume daa4d89b-5639-40d5-a4c8-7b594e21874b Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Creating offline snapshot 95fe6cee-dfbc-4f81-87e8-1bd323b0a685 of volume da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb933914-1d91-47c3-b9c5-8c716d78eb0c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:19 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 Nov 02 10:45:19 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:20 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" returned: 0 in 0.503s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:20 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 1G Nov 02 10:45:20 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:20 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 1G" returned: 0 in 0.565s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:20 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 Nov 02 10:45:20 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:21 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685" returned: 0 in 0.422s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:21 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 is being set with open permissions: ugo+rw Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:21 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 Nov 02 10:45:21 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:21 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685" returned: 0 in 0.293s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:21 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info Nov 02 10:45:21 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:21 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:21 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info is being set with open permissions: ugo+rw Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:21 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info Nov 02 10:45:21 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:21 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.info" returned: 0 in 0.309s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "cinder-quobyte-daa4d89b-5639-40d5-a4c8-7b594e21874b" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-daa4d89b-5639-40d5-a4c8-7b594e21874b" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] snapshot: 95fe6cee-dfbc-4f81-87e8-1bd323b0a685, volume: daa4d89b-5639-40d5-a4c8-7b594e21874b, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4708ab9d-20ac-4974-89cd-a9935ef4f17a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:22 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 Nov 02 10:45:22 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:22 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:45:22 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:22 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685" returned: 0 in 0.826s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7a3b7-2a56-47ab-b8d8-3c8b6b81cc30]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:23 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 Nov 02 10:45:23 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:23 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.679s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:45:23 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" returned: 0 in 0.795s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:45:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:23 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b Nov 02 10:45:23 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31415485-5dc8-4999-a3bd-ef43cf8c2d30 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" by "attach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31415485-5dc8-4999-a3bd-ef43cf8c2d30 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" acquired by "attach_volume" :: waited 0.086s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-31415485-5dc8-4999-a3bd-ef43cf8c2d30 tempest-VolumesActionsTest-1431641593 None] Attaching volume f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 to instance e30b04a7-32c0-4ca2-ab17-0188f4a48b40 at mountpoint /dev/vdb on host None. Nov 02 10:45:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-31415485-5dc8-4999-a3bd-ef43cf8c2d30 tempest-VolumesActionsTest-1431641593 None] Attach volume completed successfully. Nov 02 10:45:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31415485-5dc8-4999-a3bd-ef43cf8c2d30 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" released by "attach_volume" :: held 0.267s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4016c2b9-f97d-4a70-8aaf-678abcb0c857 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-detach_volume" by "detach_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4016c2b9-f97d-4a70-8aaf-678abcb0c857 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4016c2b9-f97d-4a70-8aaf-678abcb0c857 tempest-VolumesActionsTest-1431641593 None] Detaching volume f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 from instance e30b04a7-32c0-4ca2-ab17-0188f4a48b40. Nov 02 10:45:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4016c2b9-f97d-4a70-8aaf-678abcb0c857 tempest-VolumesActionsTest-1431641593 None] Detach volume completed successfully. Nov 02 10:45:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4016c2b9-f97d-4a70-8aaf-678abcb0c857 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (37fe4ce9-c6fb-4a76-8f97-6c4d2c83779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c5268c-a1ec-424b-80a3-7b9ee856bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c5268c-a1ec-424b-80a3-7b9ee856bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1918980378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9301164-4268-48ea-bcf5-0ddb52341099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:28Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b70776-a3db-4fc6-9b3e-24df4824df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b70776-a3db-4fc6-9b3e-24df4824df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfc8945-d80e-49bf-bb34-79bda5096eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfc8945-d80e-49bf-bb34-79bda5096eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9301164-4268-48ea-bcf5-0ddb52341099', 'volume_name': 'volume-e9301164-4268-48ea-bcf5-0ddb52341099', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b481f7b-608a-433e-a11c-077babc4e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b481f7b-608a-433e-a11c-077babc4e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429ecf22-40bb-4a92-a7d7-41d7d7eb8038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume e9301164-4268-48ea-bcf5-0ddb52341099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9301164-4268-48ea-bcf5-0ddb52341099', 'volume_size': 1} Nov 02 10:45:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:32 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b" returned: 0 in 8.971s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:32 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:45:32 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Converted 1024.00 MB image at 114.13 MB/s Nov 02 10:45:32 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b is being set with open permissions: ugo+rw Nov 02 10:45:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:32 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b Nov 02 10:45:32 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:33 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b" returned: 0 in 0.268s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-daa4d89b-5639-40d5-a4c8-7b594e21874b" released by "_copy_volume_from_snapshot" :: held 11.018s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "cinder-quobyte-95fe6cee-dfbc-4f81-87e8-1bd323b0a685" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-95fe6cee-dfbc-4f81-87e8-1bd323b0a685" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Deleting offline snapshot 95fe6cee-dfbc-4f81-87e8-1bd323b0a685 of volume da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] snapshot_file for this snap is: volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b99aba2-bbf1-47f1-8c0a-f7c7b395f6d7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:33 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 Nov 02 10:45:33 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:33 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685" returned: 0 in 0.375s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[940185f9-b306-4673-bced-39394e073d38]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:33 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 Nov 02 10:45:33 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:34 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" returned: 0 in 0.530s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:34 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 Nov 02 10:45:34 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:34 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685" returned: 0 in 0.326s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:34 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685 Nov 02 10:45:34 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:34 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32.95fe6cee-dfbc-4f81-87e8-1bd323b0a685" returned: 0 in 0.252s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-95fe6cee-dfbc-4f81-87e8-1bd323b0a685" released by "_delete_snapshot" :: held 1.587s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.274s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.496s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1918980378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9301164-4268-48ea-bcf5-0ddb52341099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:28Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating volume e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:34 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:34 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 1073741824 Nov 02 10:45:34 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94014d85-ff66-4fea-9792-07bf98d54b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa4d89b-5639-40d5-a4c8-7b594e21874b', 'volume_size': 2, 'source_volid': 'da4b8b22-5dee-4c21-8e30-8a51c9e01d32', 'source_volstatus': 'available'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e65d6d4-9c81-4175-a9b9-4029f60ae3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:34 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Volume volume-daa4d89b-5639-40d5-a4c8-7b594e21874b (daa4d89b-5639-40d5-a4c8-7b594e21874b): created successfully Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e65d6d4-9c81-4175-a9b9-4029f60ae3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Flow 'volume_create_manager' (8aa7fa99-b66e-419e-8815-e6d4494ab371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c11c259b-2d86-42bd-a80b-a5e0b7a790f5 tempest-VolumesCloneTest-1211686127 None] Created volume successfully. Nov 02 10:45:35 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 1073741824" returned: 0 in 0.464s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 Nov 02 10:45:35 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "cinder-daa4d89b-5639-40d5-a4c8-7b594e21874b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-daa4d89b-5639-40d5-a4c8-7b594e21874b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "cinder-quobyte-daa4d89b-5639-40d5-a4c8-7b594e21874b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-daa4d89b-5639-40d5-a4c8-7b594e21874b" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016ea0d-f44b-4cc2-a4d1-f398b413e8a7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.452s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:35 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b Nov 02 10:45:35 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429ecf22-40bb-4a92-a7d7-41d7d7eb8038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9301164-4268-48ea-bcf5-0ddb52341099', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1a21fe-2016-49b5-b554-940b0e5ae46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae5308d-81b8-4d07-b742-5e815f579e03]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume volume-e9301164-4268-48ea-bcf5-0ddb52341099 (e9301164-4268-48ea-bcf5-0ddb52341099): created successfully Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1a21fe-2016-49b5-b554-940b0e5ae46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (37fe4ce9-c6fb-4a76-8f97-6c4d2c83779f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d7aaa496-2188-4f9a-a011-c9bd1a9ef080 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created volume successfully. Nov 02 10:45:35 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:45:35 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b" returned: 0 in 0.401s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b Nov 02 10:45:35 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.373s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f81aeeb-78aa-4ec5-a10c-71bb6a283a61]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:45:36 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-daa4d89b-5639-40d5-a4c8-7b594e21874b" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-daa4d89b-5639-40d5-a4c8-7b594e21874b" released by "delete_volume" :: held 0.713s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Created reservations ['24c7a8e8-3943-424e-86e0-16adbfd3e5a9', '79f218e2-4e85-4d93-b7b2-571fae2c6ff2', 'b409c05e-3033-4f6f-a464-7ea414fc66ac', 'd968ba89-461a-49e1-9761-1cd3b3c8c494'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:45:36 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.372s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.c60cc3f3-b74c-4e3e-a60c-6fd494ff4fad7xzar__p.img {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.c60cc3f3-b74c-4e3e-a60c-6fd494ff4fad7xzar__p.img Nov 02 10:45:36 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Deleted volume successfully. Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d2fd2e75-22b9-4aec-ae61-e9596a0dccd0 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-daa4d89b-5639-40d5-a4c8-7b594e21874b-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "cinder-da4b8b22-5dee-4c21-8e30-8a51c9e01d32-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-da4b8b22-5dee-4c21-8e30-8a51c9e01d32-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "cinder-quobyte-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f54dce-0d83-4b1e-8a8f-14a171cd0e4b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 Nov 02 10:45:36 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:37 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" returned: 0 in 0.671s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:37 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32 Nov 02 10:45:37 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:37 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" returned: 0 in 0.391s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-quobyte-da4b8b22-5dee-4c21-8e30-8a51c9e01d32" released by "delete_volume" :: held 1.215s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Created reservations ['ae6a4175-acde-49c1-bec9-618e3143f545', '7a1ca12d-872a-4b7b-9937-8bc9a9e6d209', '1ac33edd-87ee-42ee-9bd1-bb62ff862dec', '2a69d3cb-4dc3-4ad0-a623-4a49166f83dd'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:38 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:45:38 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:38 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Deleted volume successfully. Nov 02 10:45:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-cbe72856-feac-461b-b503-9ddac2c70b68 tempest-VolumesCloneTest-1211686127 None] Lock "cinder-da4b8b22-5dee-4c21-8e30-8a51c9e01d32-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:43 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.c60cc3f3-b74c-4e3e-a60c-6fd494ff4fad7xzar__p.img" returned: 0 in 6.842s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[886eeabc-9dfd-4f4f-86d9-b305baed14e2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:43 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:45:43 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:43 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.556s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:43 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.c60cc3f3-b74c-4e3e-a60c-6fd494ff4fad7xzar__p.img {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:45:43 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Converted 1024.00 MB image at 149.64 MB/s Nov 02 10:45:43 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] c60cc3f3-b74c-4e3e-a60c-6fd494ff4fad was raw, no need to convert to raw {{(pid=86926) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (9d6eac9f-1f4d-4d3d-938b-860683a13767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bf155d-8898-4923-bb16-3f006383916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bf155d-8898-4923-bb16-3f006383916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1475138469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e687011-6035-4cc8-ac6c-1eea9221211d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:44Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721f6f3a-c102-4934-9e7d-1bed3ad6bb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721f6f3a-c102-4934-9e7d-1bed3ad6bb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cdcb58-6d22-4cb0-af84-1d5eb6a51bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cdcb58-6d22-4cb0-af84-1d5eb6a51bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e687011-6035-4cc8-ac6c-1eea9221211d', 'volume_name': 'volume-9e687011-6035-4cc8-ac6c-1eea9221211d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa202a52-cffd-4031-bd17-f588013c23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa202a52-cffd-4031-bd17-f588013c23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d198e9d1-6f35-4916-ba0e-26348f206aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Volume 9e687011-6035-4cc8-ac6c-1eea9221211d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e687011-6035-4cc8-ac6c-1eea9221211d', 'volume_size': 1} Nov 02 10:45:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:54 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=39,cinder:INSERT=13,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:54 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=41,cinder:INSERT=8,cinder:UPDATE=44,cinder:DELETE=2 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.440s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Uploaded volume to glance image-id: c60cc3f3-b74c-4e3e-a60c-6fd494ff4fad. {{(pid=86926) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:46:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 24.986s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating offline snapshot fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 of volume e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:46:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-008c9824-89a5-46df-8c75-99e7edb24b4e tempest-VolumesActionsTest-1431641593 None] Copy volume to image completed successfully. Nov 02 10:46:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e9052-2123-4f36-959b-f59f75321f46]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:02 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 Nov 02 10:46:02 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:02 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099" returned: 0 in 0.384s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:02 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 1G Nov 02 10:46:02 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:02 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 1G" returned: 0 in 0.433s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9301164-4268-48ea-bcf5-0ddb52341099 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:02 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9301164-4268-48ea-bcf5-0ddb52341099 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 Nov 02 10:46:02 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:03 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9301164-4268-48ea-bcf5-0ddb52341099 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:03 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 is being set with open permissions: ugo+rw Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:03 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 Nov 02 10:46:03 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:03 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" returned: 0 in 0.223s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:03 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info Nov 02 10:46:03 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:03 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info" returned: 0 in 0.251s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:03 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info is being set with open permissions: ugo+rw Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:03 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info Nov 02 10:46:03 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:03 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.info" returned: 0 in 0.229s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.422s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1475138469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e687011-6035-4cc8-ac6c-1eea9221211d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:44Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Creating volume 9e687011-6035-4cc8-ac6c-1eea9221211d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:03 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:03 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d 1073741824 Nov 02 10:46:03 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4ab346ea-954b-4f06-b096-bcd41d518dbd tempest-CreateVolumesFromSnapshotTest-1784219999 None] Create snapshot completed successfully Nov 02 10:46:04 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d 1073741824" returned: 0 in 0.470s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:04 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d Nov 02 10:46:04 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (c2aa7ba5-71fe-4f46-bfc7-ec733e3a77e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dc0466-e4a9-4cdc-b09d-a5d8992ef17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dc0466-e4a9-4cdc-b09d-a5d8992ef17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495184473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325ce2d7-9435-49ba-9608-52e19efbbecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:04Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485630c8-8b85-4b8c-b8a8-e1cce3625169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485630c8-8b85-4b8c-b8a8-e1cce3625169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5246e938-e990-4056-97ba-ba28eb5f8ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5246e938-e990-4056-97ba-ba28eb5f8ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325ce2d7-9435-49ba-9608-52e19efbbecf', 'volume_name': 'volume-325ce2d7-9435-49ba-9608-52e19efbbecf', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52fb5d2-022c-4452-bfee-b1991262d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52fb5d2-022c-4452-bfee-b1991262d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e387798a-91e1-48e6-a4e5-bbbbcf162049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume 325ce2d7-9435-49ba-9608-52e19efbbecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325ce2d7-9435-49ba-9608-52e19efbbecf', 'volume_size': 1} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:04 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d" returned: 0 in 0.305s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.685s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef057e87-ae75-4cae-a205-9df8ecee59df]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d198e9d1-6f35-4916-ba0e-26348f206aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e687011-6035-4cc8-ac6c-1eea9221211d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3291088-3d05-42df-9cf5-0a7c60320742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Volume volume-9e687011-6035-4cc8-ac6c-1eea9221211d (9e687011-6035-4cc8-ac6c-1eea9221211d): created successfully Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3291088-3d05-42df-9cf5-0a7c60320742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (9d6eac9f-1f4d-4d3d-938b-860683a13767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-61503732-9237-4068-9d48-bb001c8f0efa tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:46:04 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:46:04 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (63c41127-4141-4587-9d02-894741f933f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62daed8-f87e-4681-b480-f6d66e85d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62daed8-f87e-4681-b480-f6d66e85d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425623598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a9b835-1ff6-4d4e-b295-bf60be57a17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:05Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d3e7a2-f6d2-48c5-90a6-b8b040124b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d3e7a2-f6d2-48c5-90a6-b8b040124b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1dff29-e240-4eef-9b14-ab4f7c81cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1dff29-e240-4eef-9b14-ab4f7c81cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a9b835-1ff6-4d4e-b295-bf60be57a17c', 'volume_name': 'volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd038b3f-5910-43c1-9147-8337ed7c3371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd038b3f-5910-43c1-9147-8337ed7c3371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a8b91-9c7d-4b00-a328-cf9335d02d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume 63a9b835-1ff6-4d4e-b295-bf60be57a17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c', 'volume_size': 1} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:05 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.475s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee00e15-7530-4b1b-be3c-03df750eaa5b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:05 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:46:05 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (c9d4f254-24a3-4c42-ae7d-b7d93a10e9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b94e84-1981-49ea-b3d5-ede7ed8d943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b94e84-1981-49ea-b3d5-ede7ed8d943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000697949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735ea067-539b-4276-96df-9cf907fd5bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:05Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786f45c5-ea90-4411-8dc0-3954f98a89ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786f45c5-ea90-4411-8dc0-3954f98a89ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b608d441-ecd7-4217-90df-067ba89b0ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b608d441-ecd7-4217-90df-067ba89b0ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735ea067-539b-4276-96df-9cf907fd5bd3', 'volume_name': 'volume-735ea067-539b-4276-96df-9cf907fd5bd3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3951c9d5-7df7-47f5-a38a-65467bd6b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3951c9d5-7df7-47f5-a38a-65467bd6b300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44dd64e-a18f-415e-a89e-83051c33b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume 735ea067-539b-4276-96df-9cf907fd5bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735ea067-539b-4276-96df-9cf907fd5bd3', 'volume_size': 1} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:05 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.451s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:05 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img Nov 02 10:46:05 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (ef27d454-10f9-4d34-a2d6-d143f578fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5ad70a-d734-48d6-b05b-556f8480dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5ad70a-d734-48d6-b05b-556f8480dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1332752866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f781bb6a-26a6-4c6d-8b92-e85af0eae630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:06Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ee515a-6911-4298-bb9a-8cf3524b532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ee515a-6911-4298-bb9a-8cf3524b532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b5cabc-9243-4fe0-837e-1d2ae210e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b5cabc-9243-4fe0-837e-1d2ae210e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f781bb6a-26a6-4c6d-8b92-e85af0eae630', 'volume_name': 'volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fa6e0e-4868-4ef4-a20d-fbbd78686b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fa6e0e-4868-4ef4-a20d-fbbd78686b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bdbb69-3bd2-423e-b324-443408ce1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume f781bb6a-26a6-4c6d-8b92-e85af0eae630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630', 'volume_size': 1} Nov 02 10:46:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (5401410c-a899-4037-bf28-6b7b782907dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1006e9a9-35a1-44f7-b4b6-a9e34a84ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1006e9a9-35a1-44f7-b4b6-a9e34a84ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-663063472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7374e616-23c1-46e4-bd49-d6cabe16f9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:06Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a41983-a0b6-4569-bc53-021c2ad93928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a41983-a0b6-4569-bc53-021c2ad93928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168248b9-0262-459c-a3b0-e55df5999627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168248b9-0262-459c-a3b0-e55df5999627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7374e616-23c1-46e4-bd49-d6cabe16f9bb', 'volume_name': 'volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf83ce5-4dec-4cde-8d52-7b5c8013d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf83ce5-4dec-4cde-8d52-7b5c8013d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0422b27e-8956-4956-b288-3a9ac69d7fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume 7374e616-23c1-46e4-bd49-d6cabe16f9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb', 'volume_size': 1} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (15831528-51b3-4e88-b4d7-237d1ca0dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0618627-0d6b-4229-877e-9011605c982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0618627-0d6b-4229-877e-9011605c982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2111897027',display_name='tempest-VolumesGetTest-Volume-1413623917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:07Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08adf01b-79a7-42a2-a913-a377af479ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08adf01b-79a7-42a2-a913-a377af479ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e62e15e-fd4e-45c8-b1c4-5cac869fcb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e62e15e-fd4e-45c8-b1c4-5cac869fcb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a', 'volume_name': 'volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fa02f5-5c2a-4b49-9886-d393f75a72c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fa02f5-5c2a-4b49-9886-d393f75a72c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad49ee63-6b4e-47c9-925a-719d561413f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Volume 9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a', 'volume_size': 1} Nov 02 10:46:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:11 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img" returned: 0 in 6.028s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[098dc24d-2d59-4175-aba4-1ea1cb412abf]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:11 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:46:11 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:12 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.493s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:46:12 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Converted 1024.00 MB image at 169.86 MB/s Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] a6cfac3e-b935-49a1-bbb8-201bb3d96e4b was raw, converting to qcow2 {{(pid=86926) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d367299-79af-4c6c-ac0d-f6b178ad8fbc]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:12 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img Nov 02 10:46:12 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:12 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:12 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img Nov 02 10:46:12 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:12 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img" returned: 1 in 0.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:46:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:12 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90 Nov 02 10:46:12 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:13 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:13 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Image conversion details: src /opt/stack/data/cinder/conversion/f3638129-b4aa-48e2-a1b9-c9f2fdce85c7.temp_image.a6cfac3e-b935-49a1-bbb8-201bb3d96e4bv1occieq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:46:13 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 10:46:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f37876-7eec-40b3-9942-404583209f01]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:13 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90 Nov 02 10:46:13 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:13 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2vs7ed90" returned: 0 in 0.332s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Uploaded volume to glance image-id: a6cfac3e-b935-49a1-bbb8-201bb3d96e4b. {{(pid=86926) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.044s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495184473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325ce2d7-9435-49ba-9608-52e19efbbecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:04Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating volume 325ce2d7-9435-49ba-9608-52e19efbbecf {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:14 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:14 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf 1073741824 Nov 02 10:46:14 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c9030119-33ab-4750-a577-81a6eed5a1e0 tempest-VolumesActionsTest-1431641593 None] Copy volume to image completed successfully. Nov 02 10:46:15 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf 1073741824" returned: 0 in 0.391s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:15 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf Nov 02 10:46:15 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:15 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf" returned: 0 in 0.231s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.236s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425623598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a9b835-1ff6-4d4e-b295-bf60be57a17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:05Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating volume 63a9b835-1ff6-4d4e-b295-bf60be57a17c {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:15 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e387798a-91e1-48e6-a4e5-bbbbcf162049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325ce2d7-9435-49ba-9608-52e19efbbecf', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:15 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c 1073741824 Nov 02 10:46:15 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6937808e-9bfe-4054-9d92-eedadceee33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:15 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume volume-325ce2d7-9435-49ba-9608-52e19efbbecf (325ce2d7-9435-49ba-9608-52e19efbbecf): created successfully Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6937808e-9bfe-4054-9d92-eedadceee33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (c2aa7ba5-71fe-4f46-bfc7-ec733e3a77e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0aec6e8d-17ca-458f-86ff-a83a5ca4d157 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created volume successfully. Nov 02 10:46:15 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c 1073741824" returned: 0 in 0.443s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:15 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c Nov 02 10:46:15 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c" returned: 0 in 0.263s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.680s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000697949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735ea067-539b-4276-96df-9cf907fd5bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:05Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating volume 735ea067-539b-4276-96df-9cf907fd5bd3 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:16 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a8b91-9c7d-4b00-a328-cf9335d02d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:16 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 1073741824 Nov 02 10:46:16 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24a3d52-aa18-490a-bcd8-f8ee2f2c3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:16 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c (63a9b835-1ff6-4d4e-b295-bf60be57a17c): created successfully Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24a3d52-aa18-490a-bcd8-f8ee2f2c3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (63c41127-4141-4587-9d02-894741f933f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1b6c6a6d-7b73-42b9-96c6-3c22dabc14be tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created volume successfully. Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "cinder-quobyte-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-quobyte-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" acquired by "delete_volume" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da1d05-afd2-4981-b93b-2bb6d1c53155]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:46:16 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 1073741824" returned: 0 in 0.446s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 Nov 02 10:46:16 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7 Nov 02 10:46:16 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3" returned: 0 in 0.260s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.960s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1332752866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f781bb6a-26a6-4c6d-8b92-e85af0eae630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:06Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating volume f781bb6a-26a6-4c6d-8b92-e85af0eae630 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:16 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44dd64e-a18f-415e-a89e-83051c33b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735ea067-539b-4276-96df-9cf907fd5bd3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5088b18b-8b69-4766-9715-60613fa8cbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:16 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 1073741824 Nov 02 10:46:16 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume volume-735ea067-539b-4276-96df-9cf907fd5bd3 (735ea067-539b-4276-96df-9cf907fd5bd3): created successfully Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5088b18b-8b69-4766-9715-60613fa8cbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:16 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (c9d4f254-24a3-4c42-ae7d-b7d93a10e9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-01de34fb-661f-4523-a462-38ef32251add tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created volume successfully. Nov 02 10:46:17 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" returned: 0 in 0.309s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-quobyte-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7" released by "delete_volume" :: held 0.742s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Created reservations ['a30fd8d9-876f-4629-87c5-3996a29b6e9c', 'c31399bb-4d3a-4c11-adb6-c23bf2c4fc02', '74f4ebe3-b553-489d-9b25-8b23c8967963', '0c984b1f-d838-4866-b849-88d2ddbb1280'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:17 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:17 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:17 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 1073741824" returned: 0 in 0.502s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:17 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Deleted volume successfully. Nov 02 10:46:17 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 Nov 02 10:46:17 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2149bfac-ee62-4464-9969-9bfc3626b9c0 tempest-VolumesActionsTest-1431641593 None] Lock "cinder-f3638129-b4aa-48e2-a1b9-c9f2fdce85c7-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:17 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.117s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-663063472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7374e616-23c1-46e4-bd49-d6cabe16f9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97981b9bbdc74b778e43fa133a7aa5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:06Z,use_quota=True,user_id='5abcb709373546e584670624fac25d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Creating volume 7374e616-23c1-46e4-bd49-d6cabe16f9bb {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:17 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bdbb69-3bd2-423e-b324-443408ce1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:17 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb 1073741824 Nov 02 10:46:17 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b130962c-899e-403e-91ad-682e6d80055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:17 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 (f781bb6a-26a6-4c6d-8b92-e85af0eae630): created successfully Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b130962c-899e-403e-91ad-682e6d80055b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (ef27d454-10f9-4d34-a2d6-d143f578fb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-652d469d-5e73-4481-ad7d-72fbc1063036 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created volume successfully. Nov 02 10:46:18 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb 1073741824" returned: 0 in 0.548s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:18 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb Nov 02 10:46:18 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:18 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb" returned: 0 in 0.268s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.630s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2111897027',display_name='tempest-VolumesGetTest-Volume-1413623917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:07Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Creating volume 9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:18 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:18 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a 1073741824 Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0422b27e-8956-4956-b288-3a9ac69d7fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:18 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdbf4b4-4a87-4e47-8d76-7de13f4f7ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:18 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Volume volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb (7374e616-23c1-46e4-bd49-d6cabe16f9bb): created successfully Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdbf4b4-4a87-4e47-8d76-7de13f4f7ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Flow 'volume_create_manager' (5401410c-a899-4037-bf28-6b7b782907dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5d5f6e8b-1315-4b62-b870-2e62197aea7b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created volume successfully. Nov 02 10:46:19 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a 1073741824" returned: 0 in 0.466s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:19 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a Nov 02 10:46:19 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:19 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-7374e616-23c1-46e4-bd49-d6cabe16f9bb-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a" returned: 0 in 0.293s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-7374e616-23c1-46e4-bd49-d6cabe16f9bb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad49ee63-6b4e-47c9-925a-719d561413f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6362c9d-7494-4313-a392-1d5da08923b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:19 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Volume volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a (9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a): created successfully Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6362c9d-7494-4313-a392-1d5da08923b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (15831528-51b3-4e88-b4d7-237d1ca0dde7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:19 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9d8d811b-1503-42b4-9fff-f8f1f9b71819 tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-7374e616-23c1-46e4-bd49-d6cabe16f9bb" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-7374e616-23c1-46e4-bd49-d6cabe16f9bb" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb330a67-0da1-42e8-8463-45175b152ca7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:19 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb Nov 02 10:46:19 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:19 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb" returned: 0 in 0.407s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:20 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb Nov 02 10:46:20 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:20 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7374e616-23c1-46e4-bd49-d6cabe16f9bb" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-7374e616-23c1-46e4-bd49-d6cabe16f9bb" released by "delete_volume" :: held 0.697s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['75cfbcc9-d56c-48e6-82f6-40355593ffad', '2a5638dc-1872-429a-94e8-58c21676655f', '7182f9f9-cddf-49c6-a74d-4de6fb6be97f', 'a5fd71c0-0756-47a6-8e5f-e659db6dd38b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:20 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:20 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-f781bb6a-26a6-4c6d-8b92-e85af0eae630-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-f781bb6a-26a6-4c6d-8b92-e85af0eae630-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-f781bb6a-26a6-4c6d-8b92-e85af0eae630" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-f781bb6a-26a6-4c6d-8b92-e85af0eae630" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:20 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.338s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4cd9d5-8d11-42cf-af0a-d4905dced657]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:20 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleted volume successfully. Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c8f7e49-f3cd-4f90-94ac-8d5864be3865 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-7374e616-23c1-46e4-bd49-d6cabe16f9bb-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:20 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 Nov 02 10:46:20 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Lock "cinder-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d87294-0734-4982-88bc-5a4bc78a7bf7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:21 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a Nov 02 10:46:21 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:21 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630" returned: 0 in 0.500s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:21 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630 Nov 02 10:46:21 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:21 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a" returned: 0 in 0.442s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:21 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a Nov 02 10:46:21 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:21 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f781bb6a-26a6-4c6d-8b92-e85af0eae630" returned: 0 in 0.291s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-f781bb6a-26a6-4c6d-8b92-e85af0eae630" released by "delete_volume" :: held 0.857s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['1334a708-c32b-45af-8071-d0e466d47310', '1eff6aca-3012-4a1e-ab53-d16061ab9e2e', '8fd65b97-0566-48b3-9bee-33a07bc422c8', '62834e9e-9465-4c79-aaac-3d4f3a2602fb'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:21 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:21 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:21 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a" returned: 0 in 0.356s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-735ea067-539b-4276-96df-9cf907fd5bd3-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a" released by "delete_volume" :: held 0.884s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-735ea067-539b-4276-96df-9cf907fd5bd3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-735ea067-539b-4276-96df-9cf907fd5bd3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-735ea067-539b-4276-96df-9cf907fd5bd3" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Created reservations ['0f3ecd0b-0367-4f58-a088-e3663a2ea1c5', '5d7a47c9-8089-42c2-9e72-10fb2f2983d7', '0da4029b-9635-4c74-8d78-797f758b68e7', '07537b5f-8d00-4fbf-afe1-0974706fdd1d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:21 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.322s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153d5e3-40a6-4d64-b2f7-af6b73c8a52f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleted volume successfully. Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7bb7c345-e619-4336-8df4-e84b38021e0b tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-f781bb6a-26a6-4c6d-8b92-e85af0eae630-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:22 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 Nov 02 10:46:22 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:22 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:22 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:22 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:46:22 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8b616a96-4bf9-4450-887c-8be0f09057a3 tempest-VolumesGetTest-733416880 None] Lock "cinder-9bcbd847-3fb8-4d9d-b57e-cc2a21dc189a-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3" returned: 0 in 0.437s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:22 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3 Nov 02 10:46:22 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:22 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:22 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:22 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-735ea067-539b-4276-96df-9cf907fd5bd3" returned: 0 in 0.278s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-735ea067-539b-4276-96df-9cf907fd5bd3" released by "delete_volume" :: held 0.794s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['7aabec2e-e45f-465f-904f-3e4b1dab4417', 'ac550c3e-f49a-4978-b4c1-1aa56966d81a', 'dcba1cf4-4a02-4133-8651-3c4bbed2688d', 'e782e308-31d1-49b6-906c-50fbd9556d77'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:22 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.298s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:22 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:22 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-63a9b835-1ff6-4d4e-b295-bf60be57a17c-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-63a9b835-1ff6-4d4e-b295-bf60be57a17c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-63a9b835-1ff6-4d4e-b295-bf60be57a17c" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-63a9b835-1ff6-4d4e-b295-bf60be57a17c" acquired by "delete_volume" :: waited 0.044s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c53b5-b674-4166-903c-5b535e20efef]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-9e687011-6035-4cc8-ac6c-1eea9221211d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Lock "cinder-9e687011-6035-4cc8-ac6c-1eea9221211d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:23 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c Nov 02 10:46:23 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:23 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.415s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-9e687011-6035-4cc8-ac6c-1eea9221211d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleted volume successfully. Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-9e687011-6035-4cc8-ac6c-1eea9221211d" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d72203e0-f74b-4d45-a1d7-3f63379117c0 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-735ea067-539b-4276-96df-9cf907fd5bd3-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb25c1b-b6d2-47e9-a469-e8cd2d7536c9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:23 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d Nov 02 10:46:23 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:23 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c" returned: 0 in 0.427s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:23 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c Nov 02 10:46:23 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:23 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d" returned: 0 in 0.410s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:23 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d Nov 02 10:46:23 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:23 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-63a9b835-1ff6-4d4e-b295-bf60be57a17c" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-63a9b835-1ff6-4d4e-b295-bf60be57a17c" released by "delete_volume" :: held 0.787s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['7584fda1-a25e-4b14-a14c-7bbc27a052c9', '81f0d7e2-474b-480f-a555-fe4fa2f8d320', 'f35a9086-da37-4643-a791-eb63c5622ce9', 'd27b04b2-3979-4a51-a098-5be15728c4e0'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:24 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9e687011-6035-4cc8-ac6c-1eea9221211d" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:24 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:24 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-9e687011-6035-4cc8-ac6c-1eea9221211d" released by "delete_volume" :: held 0.746s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Created reservations ['8c6076a4-9371-4ba4-be96-c1db69218396', '396baaf5-2518-4188-abdf-d27ca39fb101', '35588bd0-ee1d-4148-8a7f-c61a62f3af1e', '7950da9c-7261-47d6-9ff8-d95c2e94dbe0'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-325ce2d7-9435-49ba-9608-52e19efbbecf-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-325ce2d7-9435-49ba-9608-52e19efbbecf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:24 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:24 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-325ce2d7-9435-49ba-9608-52e19efbbecf" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-325ce2d7-9435-49ba-9608-52e19efbbecf" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42206ab-7cfd-46ea-ac6c-76ca1a0fe209]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:24 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:24 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleted volume successfully. Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1d13f8a7-6f7a-4e37-a543-2000c93d9764 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-63a9b835-1ff6-4d4e-b295-bf60be57a17c-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:24 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf Nov 02 10:46:24 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:24 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:24 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9f288e9b-69da-4361-b3ac-c075f9304b9d tempest-VolumesGetTest-733416880 None] Lock "cinder-9e687011-6035-4cc8-ac6c-1eea9221211d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:24 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf" returned: 0 in 0.450s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:24 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf Nov 02 10:46:24 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:25 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (31ec1459-6300-4d0a-b154-7622732e1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09279e13-a993-42b6-adb2-dd0461f1e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-325ce2d7-9435-49ba-9608-52e19efbbecf" returned: 0 in 0.304s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09279e13-a993-42b6-adb2-dd0461f1e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490528676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:25Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5456545b-2019-4812-af8d-587b4d6bb781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5456545b-2019-4812-af8d-587b4d6bb781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7ea4d6-1d23-4c91-9586-837e59e82c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7ea4d6-1d23-4c91-9586-837e59e82c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'volume_name': 'volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e5ba14-595d-4389-8ce0-18c1a65305cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e5ba14-595d-4389-8ce0-18c1a65305cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ed89b4-f959-46e5-b81c-67f8a174d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Volume 0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'volume_size': 1} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490528676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:25Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Creating volume 0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:25 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-325ce2d7-9435-49ba-9608-52e19efbbecf" released by "delete_volume" :: held 0.909s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:25 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe 1073741824 Nov 02 10:46:25 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['0eb45265-3859-4484-95ab-081957b8db78', '606e1792-8b99-4645-95e0-896a0a46282d', 'd6add71b-e366-403b-b106-60d9ae1ea199', '64432273-abbb-49fd-969b-3c80eed991e8'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-fd49d9c5-21a1-41f4-ab0e-ac23dcf13207-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:25 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:25 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-fd49d9c5-21a1-41f4-ab0e-ac23dcf13207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-e9301164-4268-48ea-bcf5-0ddb52341099" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-e9301164-4268-48ea-bcf5-0ddb52341099" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleting offline snapshot fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 of volume e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] snapshot_file for this snap is: volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd785d08-b4b5-41cf-ad4f-5fd7e6cc31cc]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:25 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 Nov 02 10:46:25 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:25 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:25 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.389s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe 1073741824" returned: 0 in 0.614s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleted volume successfully. Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b07217a1-f966-4140-be1d-ce4f8304d9e3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-325ce2d7-9435-49ba-9608-52e19efbbecf-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:26 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe Nov 02 10:46:26 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Flow 'volume_create_manager' (2451cbd8-3bb4-4a8d-adac-ab0de73f16ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555ccafa-9bc1-4c7f-a6b5-f6f2bcc3106b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555ccafa-9bc1-4c7f-a6b5-f6f2bcc3106b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-153714728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44840033-5bfc-44de-845c-a0ae950e10d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556f746d994f07b903f5fe6941bab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:26Z,use_quota=True,user_id='b73c4b1cca374949869ebf4189e2ad6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44178e83-c1e4-4a65-8aa2-91dc658eb51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44178e83-c1e4-4a65-8aa2-91dc658eb51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda7c4ec-b43b-45f5-a6f2-f8229d7730f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda7c4ec-b43b-45f5-a6f2-f8229d7730f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44840033-5bfc-44de-845c-a0ae950e10d0', 'volume_name': 'volume-44840033-5bfc-44de-845c-a0ae950e10d0', 'volume_size': 2}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175fe777-236a-467f-9e5f-d58ee68cb4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175fe777-236a-467f-9e5f-d58ee68cb4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d25ffbd-1d6d-4371-aae4-1d05c6f3c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Volume 44840033-5bfc-44de-845c-a0ae950e10d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44840033-5bfc-44de-845c-a0ae950e10d0', 'volume_size': 2} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:26 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" returned: 0 in 0.495s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9301164-4268-48ea-bcf5-0ddb52341099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33021f1-8c63-48ea-89ba-344875730c24]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:26 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" returned: 0 in 0.297s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.091s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-153714728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44840033-5bfc-44de-845c-a0ae950e10d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556f746d994f07b903f5fe6941bab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:26Z,use_quota=True,user_id='b73c4b1cca374949869ebf4189e2ad6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Creating volume 44840033-5bfc-44de-845c-a0ae950e10d0 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:26 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 2147483648 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ed89b4-f959-46e5-b81c-67f8a174d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 2147483648 Nov 02 10:46:26 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109e1c1d-1a67-4a90-bdc5-cddc8e323d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Volume volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe (0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe): created successfully Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109e1c1d-1a67-4a90-bdc5-cddc8e323d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (31ec1459-6300-4d0a-b154-7622732e1a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4019cb6b-2d06-42d3-893d-30050987cea2 tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:46:26 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 Nov 02 10:46:26 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:26 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:26 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 Nov 02 10:46:26 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:26 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 2147483648" returned: 0 in 0.504s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:26 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 Nov 02 10:46:26 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:27 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" returned: 0 in 0.403s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:27 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:27 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207 Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0" returned: 0 in 0.254s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:27 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d25ffbd-1d6d-4371-aae4-1d05c6f3c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44840033-5bfc-44de-845c-a0ae950e10d0', 'volume_size': 2}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca5f1f9-b42b-4dbe-8587-f5304fe99eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:27 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Volume volume-44840033-5bfc-44de-845c-a0ae950e10d0 (44840033-5bfc-44de-845c-a0ae950e10d0): created successfully Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca5f1f9-b42b-4dbe-8587-f5304fe99eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Flow 'volume_create_manager' (2451cbd8-3bb4-4a8d-adac-ab0de73f16ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-daf2c693-b228-4f68-8696-d5ad5b769b6e tempest-VolumesCloneNegativeTest-205689399 None] Created volume successfully. Nov 02 10:46:27 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099.fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" returned: 0 in 0.246s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-fd49d9c5-21a1-41f4-ab0e-ac23dcf13207" released by "_delete_snapshot" :: held 1.685s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-e9301164-4268-48ea-bcf5-0ddb52341099" released by "delete_snapshot" :: held 1.719s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['837c09ef-a8f6-4398-85f3-a6fcc258549f', 'febeafef-cd83-4af2-8000-f7dbd024d3cf', 'e0168b5d-9baa-4b07-8b6a-8e49abfc7512', 'c3cf6192-872f-4140-89c0-9fb431f3a277'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Delete snapshot completed successfully. Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fbc14951-47c8-4cb3-b475-b1991b1be9f3 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-fd49d9c5-21a1-41f4-ab0e-ac23dcf13207-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-e9301164-4268-48ea-bcf5-0ddb52341099-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (06af7154-f986-4266-937e-ee58761458a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9150f309-96ad-444b-894c-489985c928c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-e9301164-4268-48ea-bcf5-0ddb52341099-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9150f309-96ad-444b-894c-489985c928c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809963606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468c1432-33f4-4646-a2a5-92373642156e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:28Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064e930a-3def-467e-a72e-0aea88cb7065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064e930a-3def-467e-a72e-0aea88cb7065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6609f70d-8e6c-4d29-ba6a-6e77e88001fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6609f70d-8e6c-4d29-ba6a-6e77e88001fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '468c1432-33f4-4646-a2a5-92373642156e', 'volume_name': 'volume-468c1432-33f4-4646-a2a5-92373642156e', 'volume_size': 1, 'source_volid': '0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'source_volstatus': 'available'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7768bc9-6e76-4f29-955d-c7f9cef2132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7768bc9-6e76-4f29-955d-c7f9cef2132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35550c57-776f-4ba2-9e6c-2a0e4f91f271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:27 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Volume 468c1432-33f4-4646-a2a5-92373642156e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-468c1432-33f4-4646-a2a5-92373642156e', 'volume_size': 1, 'source_volid': '0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'source_volstatus': 'available'} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "cinder-quobyte-e9301164-4268-48ea-bcf5-0ddb52341099" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:27 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Cloning volume 0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe to volume 468c1432-33f4-4646-a2a5-92373642156e Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-e9301164-4268-48ea-bcf5-0ddb52341099" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Creating offline snapshot e4671f90-25d4-45eb-812e-cf72cbaba824 of volume 0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[088edd61-6a0a-4eb5-89e2-499caeed1902]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921c1fa-2082-486f-b662-5bdf68ac15f8]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 Nov 02 10:46:28 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:28 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe Nov 02 10:46:28 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Acquiring lock "cinder-44840033-5bfc-44de-845c-a0ae950e10d0-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Lock "cinder-44840033-5bfc-44de-845c-a0ae950e10d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Acquiring lock "cinder-quobyte-44840033-5bfc-44de-845c-a0ae950e10d0" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Lock "cinder-quobyte-44840033-5bfc-44de-845c-a0ae950e10d0" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8e456-2fba-404b-9ca9-6b0c634f43f9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" returned: 0 in 0.465s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099" returned: 0 in 0.499s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 1G Nov 02 10:46:28 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:28 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099 Nov 02 10:46:28 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:28 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 Nov 02 10:46:28 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:28 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e9301164-4268-48ea-bcf5-0ddb52341099" returned: 0 in 0.365s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-quobyte-e9301164-4268-48ea-bcf5-0ddb52341099" released by "delete_volume" :: held 0.958s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:28 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0" returned: 0 in 0.509s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Created reservations ['d6028734-10d8-472a-8e93-132da5b2dae2', '607aefbb-93b2-4c8b-8786-5eafa693b005', '97206cae-861c-4f27-828b-0032e065ec1b', '09ef7e53-6855-4967-b23b-9233e03cf2af'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:28 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0 Nov 02 10:46:28 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:29 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 1G" returned: 0 in 0.618s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:29 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 Nov 02 10:46:29 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-44840033-5bfc-44de-845c-a0ae950e10d0" returned: 0 in 0.291s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Lock "cinder-quobyte-44840033-5bfc-44de-845c-a0ae950e10d0" released by "delete_volume" :: held 0.854s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Created reservations ['5cff8d87-71b6-4627-ada5-da2935c32daa', '01531eea-e840-417d-8d47-5c7c2fd9fd68', '3055fbd1-6702-49a3-bdb4-de384624b169', '6e54ec1c-44c2-4e09-913f-d30c5d4f1bb3'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:29 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Deleted volume successfully. Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c5c3a16-21aa-4abf-b8a6-e08e64506a52 tempest-CreateVolumesFromSnapshotTest-1784219999 None] Lock "cinder-e9301164-4268-48ea-bcf5-0ddb52341099-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824" returned: 0 in 0.360s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:29 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 is being set with open permissions: ugo+rw Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 Nov 02 10:46:29 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.275s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Deleted volume successfully. Nov 02 10:46:29 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-575a6c72-d846-4698-ad0e-ae0ca8c7a7ea tempest-VolumesCloneNegativeTest-205689399 None] Lock "cinder-44840033-5bfc-44de-845c-a0ae950e10d0-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info Nov 02 10:46:29 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:30 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:30 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info is being set with open permissions: ugo+rw Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:30 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info Nov 02 10:46:30 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:30 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.info" returned: 0 in 0.290s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-468c1432-33f4-4646-a2a5-92373642156e" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-468c1432-33f4-4646-a2a5-92373642156e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] snapshot: e4671f90-25d4-45eb-812e-cf72cbaba824, volume: 468c1432-33f4-4646-a2a5-92373642156e, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8aedf-a870-48d0-b04e-4112cb3c80b4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:30 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 Nov 02 10:46:30 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:30 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824" returned: 0 in 0.501s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9dcf81-6e12-4385-8e46-af3d6cbcefa5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:31 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe Nov 02 10:46:31 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:31 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" returned: 0 in 0.436s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:46:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:46:31 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:46:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:31 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e Nov 02 10:46:31 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (c05517dd-8511-4184-8076-cf565b6eb867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c763c6-2e68-49e5-bae8-5ceaebe5f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c763c6-2e68-49e5-bae8-5ceaebe5f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039672838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:35Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2847b10-8286-4b65-94c8-5c4408615d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2847b10-8286-4b65-94c8-5c4408615d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed056b5-541e-4f9d-8416-f9373dbdd3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed056b5-541e-4f9d-8416-f9373dbdd3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e', 'volume_name': 'volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dbb288-87f0-433c-a122-6a328edf8032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dbb288-87f0-433c-a122-6a328edf8032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2222eca-df1b-423f-b2dc-c6d45f7ed6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:34 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume 012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e', 'volume_size': 1} Nov 02 10:46:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:38 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e" returned: 0 in 7.549s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:38 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:46:38 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Converted 1024.00 MB image at 135.64 MB/s Nov 02 10:46:38 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e is being set with open permissions: ugo+rw Nov 02 10:46:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:38 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e Nov 02 10:46:38 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:39 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e" returned: 0 in 0.251s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-468c1432-33f4-4646-a2a5-92373642156e" released by "_copy_volume_from_snapshot" :: held 8.830s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-e4671f90-25d4-45eb-812e-cf72cbaba824" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-e4671f90-25d4-45eb-812e-cf72cbaba824" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Deleting offline snapshot e4671f90-25d4-45eb-812e-cf72cbaba824 of volume 0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] snapshot_file for this snap is: volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[157fa8d6-4243-464e-b5b5-41021bd896ee]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:39 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 Nov 02 10:46:39 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:39 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824" returned: 0 in 0.377s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8eaba3-db0e-4165-b9eb-b4b69b3b0032]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:39 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe Nov 02 10:46:39 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:40 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" returned: 0 in 0.540s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 Nov 02 10:46:40 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:40 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824" returned: 0 in 0.333s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824 Nov 02 10:46:40 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:40 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe.e4671f90-25d4-45eb-812e-cf72cbaba824" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-e4671f90-25d4-45eb-812e-cf72cbaba824" released by "_delete_snapshot" :: held 1.711s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.073s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.128s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039672838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:35Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Creating volume 012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:41 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35550c57-776f-4ba2-9e6c-2a0e4f91f271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468c1432-33f4-4646-a2a5-92373642156e', 'volume_size': 1, 'source_volid': '0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe', 'source_volstatus': 'available'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b4993-f06e-446b-9132-1d3eb454c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e 1073741824 Nov 02 10:46:41 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Volume volume-468c1432-33f4-4646-a2a5-92373642156e (468c1432-33f4-4646-a2a5-92373642156e): created successfully Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b4993-f06e-446b-9132-1d3eb454c3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (06af7154-f986-4266-937e-ee58761458a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dceaa980-6e60-465a-b094-c8669e93ab39 tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:46:41 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e 1073741824" returned: 0 in 0.489s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e Nov 02 10:46:41 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e" returned: 0 in 0.252s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2222eca-df1b-423f-b2dc-c6d45f7ed6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d2bc98-b755-4d3f-821d-e2b180bc9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e (012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e): created successfully Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d2bc98-b755-4d3f-821d-e2b180bc9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (c05517dd-8511-4184-8076-cf565b6eb867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a47837dc-2e58-418e-9583-91cc2e746a5b tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created volume successfully. Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (6e595a81-d64e-4a86-83d3-00e9d19b1960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a2b1b5-a7f9-477a-8ea4-e558f18bc93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (93d752c6-1cf2-4ba7-845f-66e52728a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b033cd62-4b2c-4992-aa02-6d25c8ffe43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a2b1b5-a7f9-477a-8ea4-e558f18bc93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903632072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d271e9a-579d-48f9-b587-111959f05b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:43Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72af9d3d-b41d-4414-847d-d85ae64cb7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72af9d3d-b41d-4414-847d-d85ae64cb7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9984f8f1-9514-48b5-87f7-48e13ed255a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9984f8f1-9514-48b5-87f7-48e13ed255a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d271e9a-579d-48f9-b587-111959f05b13', 'volume_name': 'volume-0d271e9a-579d-48f9-b587-111959f05b13', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddfa5b7-b0d5-4395-9c6b-0da85177b53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddfa5b7-b0d5-4395-9c6b-0da85177b53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e4731a-72a7-402c-8bd8-1d853c97efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume 0d271e9a-579d-48f9-b587-111959f05b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d271e9a-579d-48f9-b587-111959f05b13', 'volume_size': 1} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903632072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d271e9a-579d-48f9-b587-111959f05b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:43Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Creating volume 0d271e9a-579d-48f9-b587-111959f05b13 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:43 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:43 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 1073741824 Nov 02 10:46:43 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b033cd62-4b2c-4992-aa02-6d25c8ffe43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1417936243',display_name='tempest-VolumesGetTest-Volume-762950745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec209d52-2f39-4f24-99fa-1678b0bc1b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:43Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df5c4b9-c37f-4fe7-9f01-b34b34a008af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df5c4b9-c37f-4fe7-9f01-b34b34a008af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef23f4dc-6564-4254-9aa8-41f1713a3053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef23f4dc-6564-4254-9aa8-41f1713a3053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec209d52-2f39-4f24-99fa-1678b0bc1b71', 'volume_name': 'volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168eb036-c657-4137-a84a-cdd22ebb0b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168eb036-c657-4137-a84a-cdd22ebb0b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34127042-2f4f-4deb-aba8-2194efcf4054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Volume ec209d52-2f39-4f24-99fa-1678b0bc1b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71', 'volume_size': 1} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (57a5b776-848c-4a76-ba05-321bf308e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a211f9d-2ae5-46d2-922d-37f95ee9544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a211f9d-2ae5-46d2-922d-37f95ee9544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786834548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317f5fb6-197a-427a-81d8-6fbb319d7901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:43Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1b7732-7ee8-4f2d-bf4a-417471fb2789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1b7732-7ee8-4f2d-bf4a-417471fb2789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405daf10-fc85-4ad6-9f90-309083ee56da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405daf10-fc85-4ad6-9f90-309083ee56da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317f5fb6-197a-427a-81d8-6fbb319d7901', 'volume_name': 'volume-317f5fb6-197a-427a-81d8-6fbb319d7901', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf313cf-cc70-4beb-bb48-105ba1812ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf313cf-cc70-4beb-bb48-105ba1812ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0998d318-d653-4ae9-964e-7925af880949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume 317f5fb6-197a-427a-81d8-6fbb319d7901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317f5fb6-197a-427a-81d8-6fbb319d7901', 'volume_size': 1} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (7c398225-5077-4edf-80f4-4fa73056f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dd76d6-e487-468a-bc59-ddae3277509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dd76d6-e487-468a-bc59-ddae3277509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000041430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4809442-7ecb-4889-803b-7d34ca7bff84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:44Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02685cc5-6722-4630-9720-11d35757d15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02685cc5-6722-4630-9720-11d35757d15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a96103-5b87-4b6e-bf08-a1313a92a597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a96103-5b87-4b6e-bf08-a1313a92a597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4809442-7ecb-4889-803b-7d34ca7bff84', 'volume_name': 'volume-d4809442-7ecb-4889-803b-7d34ca7bff84', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5c86a3-89cb-4d2a-b32a-43cfb2ff3da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5c86a3-89cb-4d2a-b32a-43cfb2ff3da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1c296f-9d91-4471-9908-6ab24825f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume d4809442-7ecb-4889-803b-7d34ca7bff84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4809442-7ecb-4889-803b-7d34ca7bff84', 'volume_size': 1} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:43 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 1073741824" returned: 0 in 0.627s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:43 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 Nov 02 10:46:43 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:44 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (75007200-19f9-47ae-9983-71795dcbb66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b253c2-28c6-46b3-8e93-43c629e24361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13" returned: 0 in 0.346s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1417936243',display_name='tempest-VolumesGetTest-Volume-762950745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec209d52-2f39-4f24-99fa-1678b0bc1b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:43Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Creating volume ec209d52-2f39-4f24-99fa-1678b0bc1b71 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:44 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b253c2-28c6-46b3-8e93-43c629e24361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81800248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9285e9-36bd-4bf1-965e-2150f0bebeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:44Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7573f58c-cd9b-4ffe-8ceb-fa5b9f7d2fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 1073741824 Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7573f58c-cd9b-4ffe-8ceb-fa5b9f7d2fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e14582-0237-4b04-9c97-07451ad65468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e14582-0237-4b04-9c97-07451ad65468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9285e9-36bd-4bf1-965e-2150f0bebeaa', 'volume_name': 'volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9edc41-d7c5-4796-a288-dc5d8b5c25d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9edc41-d7c5-4796-a288-dc5d8b5c25d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c11fb1-c805-4fed-b802-1a573c591f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume 8e9285e9-36bd-4bf1-965e-2150f0bebeaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa', 'volume_size': 1} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e4731a-72a7-402c-8bd8-1d853c97efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d271e9a-579d-48f9-b587-111959f05b13', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1342668-7c03-4cb1-8614-95f201deb4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume volume-0d271e9a-579d-48f9-b587-111959f05b13 (0d271e9a-579d-48f9-b587-111959f05b13): created successfully Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1342668-7c03-4cb1-8614-95f201deb4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (6e595a81-d64e-4a86-83d3-00e9d19b1960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-90fe1b8a-c787-45f6-bb8c-f96482b161e1 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created volume successfully. Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (a06f7fd3-9ad0-42a2-bf66-9342570806a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bd7fba-3ec4-4cc6-b226-252a93a8e947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bd7fba-3ec4-4cc6-b226-252a93a8e947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374729134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c8f8c1-aa44-452a-a63b-e1bf799f18c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:45Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6bdec0-82ec-44c1-9c93-fe362ee50fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6bdec0-82ec-44c1-9c93-fe362ee50fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c5bcd2-44e3-4eff-b8be-4c267beca8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c5bcd2-44e3-4eff-b8be-4c267beca8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c8f8c1-aa44-452a-a63b-e1bf799f18c2', 'volume_name': 'volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fe72fd-8018-41ed-96f8-b9029383b504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fe72fd-8018-41ed-96f8-b9029383b504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ce90c6-aa95-4250-b7af-80049982e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume 47c8f8c1-aa44-452a-a63b-e1bf799f18c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2', 'volume_size': 1} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:44 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 1073741824" returned: 0 in 0.685s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:45 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 Nov 02 10:46:45 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:45 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71" returned: 0 in 0.247s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786834548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317f5fb6-197a-427a-81d8-6fbb319d7901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:43Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Creating volume 317f5fb6-197a-427a-81d8-6fbb319d7901 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:45 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34127042-2f4f-4deb-aba8-2194efcf4054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:45 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 1073741824 Nov 02 10:46:45 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216902e3-0e42-4bc1-b370-0f441d6059c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:45 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Volume volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 (ec209d52-2f39-4f24-99fa-1678b0bc1b71): created successfully Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216902e3-0e42-4bc1-b370-0f441d6059c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (93d752c6-1cf2-4ba7-845f-66e52728a47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-48fc0d5b-6e13-4b8f-914f-fd4af3a7481d tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:46:45 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 1073741824" returned: 0 in 0.537s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:45 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 Nov 02 10:46:45 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-ec209d52-2f39-4f24-99fa-1678b0bc1b71-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:46 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Lock "cinder-ec209d52-2f39-4f24-99fa-1678b0bc1b71-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000041430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4809442-7ecb-4889-803b-7d34ca7bff84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:44Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Creating volume d4809442-7ecb-4889-803b-7d34ca7bff84 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:46 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 1073741824 Nov 02 10:46:46 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0998d318-d653-4ae9-964e-7925af880949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317f5fb6-197a-427a-81d8-6fbb319d7901', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2191481-0a77-4bae-92c9-bd4f3a9bef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:46 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume volume-317f5fb6-197a-427a-81d8-6fbb319d7901 (317f5fb6-197a-427a-81d8-6fbb319d7901): created successfully Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2191481-0a77-4bae-92c9-bd4f3a9bef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (57a5b776-848c-4a76-ba05-321bf308e044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-ec209d52-2f39-4f24-99fa-1678b0bc1b71" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-febb5a67-b305-4ddd-ac12-a96d16a9aac0 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created volume successfully. Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-ec209d52-2f39-4f24-99fa-1678b0bc1b71" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c12781a-77ac-4f58-af61-ebab2107d8f0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 Nov 02 10:46:46 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 1073741824" returned: 0 in 0.632s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71" returned: 0 in 0.478s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71 Nov 02 10:46:46 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 Nov 02 10:46:46 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ec209d52-2f39-4f24-99fa-1678b0bc1b71" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-ec209d52-2f39-4f24-99fa-1678b0bc1b71" released by "delete_volume" :: held 0.816s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.850s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81800248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9285e9-36bd-4bf1-965e-2150f0bebeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:44Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Creating volume 8e9285e9-36bd-4bf1-965e-2150f0bebeaa {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:47 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:47 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa 1073741824 Nov 02 10:46:47 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1c296f-9d91-4471-9908-6ab24825f927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4809442-7ecb-4889-803b-7d34ca7bff84', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e23e70-d323-444b-bbaf-8c469634be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume volume-d4809442-7ecb-4889-803b-7d34ca7bff84 (d4809442-7ecb-4889-803b-7d34ca7bff84): created successfully Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e23e70-d323-444b-bbaf-8c469634be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (7c398225-5077-4edf-80f4-4fa73056f384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fe2466a8-4f11-4995-9547-d37e641208db tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created volume successfully. Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Created reservations ['25560cae-36ee-47b7-830f-9e01cd04c428', '31705e75-400e-4bca-8466-e71d509ca3a3', 'f440144a-69a4-45bb-bb93-3bff0387bbda', 'f63d6028-cc0b-4136-994b-d8ccde81eb37'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:47 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:47 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:46:47 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa 1073741824" returned: 0 in 0.537s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ef6a6f2-c63b-41e3-81ef-ff1319d6ffb8 tempest-VolumesGetTest-733416880 None] Lock "cinder-ec209d52-2f39-4f24-99fa-1678b0bc1b71-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:47 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa Nov 02 10:46:47 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (1c752558-0ddc-46bc-adf3-26e0cde23df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a099ee43-4e44-4136-bb06-b29335193bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a099ee43-4e44-4136-bb06-b29335193bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-748826815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197fc9b6-7546-4a34-8443-e2d9f0fb07d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:48Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0bce74-c1a3-46ca-8880-b984c5586c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0bce74-c1a3-46ca-8880-b984c5586c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f879ebd-c7e6-485b-a5d8-7d9798ef83cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f879ebd-c7e6-485b-a5d8-7d9798ef83cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197fc9b6-7546-4a34-8443-e2d9f0fb07d7', 'volume_name': 'volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a43201-7bb1-494b-9699-adba75df20af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a43201-7bb1-494b-9699-adba75df20af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05adf0d3-4ef6-4b05-9241-0c13f38a05d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Volume 197fc9b6-7546-4a34-8443-e2d9f0fb07d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7', 'volume_size': 1} Nov 02 10:46:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:48 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa" returned: 0 in 0.250s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.295s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374729134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c8f8c1-aa44-452a-a63b-e1bf799f18c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3248233b919246478be57cf961a681de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:45Z,use_quota=True,user_id='b88a2be7c8774a0f864c6830514de294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Creating volume 47c8f8c1-aa44-452a-a63b-e1bf799f18c2 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c11fb1-c805-4fed-b802-1a573c591f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 1073741824 Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdc1b8d-ce84-45e9-be20-45f621acc96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa (8e9285e9-36bd-4bf1-965e-2150f0bebeaa): created successfully Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdc1b8d-ce84-45e9-be20-45f621acc96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (75007200-19f9-47ae-9983-71795dcbb66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e1f8a97b-ce28-4acd-b5a2-6916fab3ee55 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created volume successfully. Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-468c1432-33f4-4646-a2a5-92373642156e-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Lock "cinder-468c1432-33f4-4646-a2a5-92373642156e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:48 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 1073741824" returned: 0 in 0.477s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-468c1432-33f4-4646-a2a5-92373642156e" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-468c1432-33f4-4646-a2a5-92373642156e" acquired by "delete_volume" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:48 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 Nov 02 10:46:48 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9f85f-ee9a-417d-9343-3fcdd80b3aeb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e Nov 02 10:46:48 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-748826815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197fc9b6-7546-4a34-8443-e2d9f0fb07d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:48Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Creating volume 197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ce90c6-aa95-4250-b7af-80049982e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 1073741824 Nov 02 10:46:48 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e862294e-058f-49f2-98c8-d87fb3bf1b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Volume volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 (47c8f8c1-aa44-452a-a63b-e1bf799f18c2): created successfully Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e862294e-058f-49f2-98c8-d87fb3bf1b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Flow 'volume_create_manager' (a06f7fd3-9ad0-42a2-bf66-9342570806a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-337b3c4f-f90b-49f9-9e20-94bf35ef0512 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created volume successfully. Nov 02 10:46:48 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e" returned: 0 in 0.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:49 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e Nov 02 10:46:49 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-47c8f8c1-aa44-452a-a63b-e1bf799f18c2-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-47c8f8c1-aa44-452a-a63b-e1bf799f18c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-quobyte-47c8f8c1-aa44-452a-a63b-e1bf799f18c2" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-47c8f8c1-aa44-452a-a63b-e1bf799f18c2" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:49 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-468c1432-33f4-4646-a2a5-92373642156e" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-468c1432-33f4-4646-a2a5-92373642156e" released by "delete_volume" :: held 0.745s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497bd89-adf2-4e9d-90a1-cc11db7573b5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:49 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 1073741824" returned: 0 in 0.512s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Created reservations ['68654a47-4883-4848-b8cb-b788a610acfb', 'ab4ded71-9f3a-4de7-ac47-885bf51fe68e', '045a46ff-4ad5-4776-b35a-c8ae84e2d52c', '5b17f8f8-80c5-4266-a760-613371b1d41c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:49 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 Nov 02 10:46:49 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:49 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 Nov 02 10:46:49 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:49 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:49 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:49 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05adf0d3-4ef6-4b05-9241-0c13f38a05d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dadf06-ca62-4e49-b4a1-8d60c99bae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:49 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Volume volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 (197fc9b6-7546-4a34-8443-e2d9f0fb07d7): created successfully Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dadf06-ca62-4e49-b4a1-8d60c99bae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (1c752558-0ddc-46bc-adf3-26e0cde23df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:49 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2" returned: 0 in 0.449s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2fa2560b-8fe4-4920-aec7-cde84b3de676 tempest-VolumesSnapshotTestJSON-769721684 None] Created volume successfully. Nov 02 10:46:49 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.316s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Lock "cinder-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:46:49 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2 Nov 02 10:46:49 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7788c070-348a-44b0-93ff-9b28bf6df009 tempest-VolumesGetTest-733416880 None] Lock "cinder-468c1432-33f4-4646-a2a5-92373642156e-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[596fe2f4-fa23-4afd-bc44-7d848e367cf0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe Nov 02 10:46:50 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-47c8f8c1-aa44-452a-a63b-e1bf799f18c2" returned: 0 in 0.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-47c8f8c1-aa44-452a-a63b-e1bf799f18c2" released by "delete_volume" :: held 0.837s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created reservations ['739780cf-eaa8-4601-a532-80a35fea91e5', 'e02e537b-a6df-4424-a451-958005d011e5', '3d5e232d-7ef6-4cf0-a91d-be4ba00ac979', 'cf503325-4a00-4b1f-8c7d-c2f97f1f531f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:50 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Creating offline snapshot 674d3ce5-0614-45a2-a440-4b99e6ca2ad5 of volume 197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9817665f-c7e4-41bb-9e9c-ec8e429f1e3c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" returned: 0 in 0.442s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-8e9285e9-36bd-4bf1-965e-2150f0bebeaa-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:50 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-8e9285e9-36bd-4bf1-965e-2150f0bebeaa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:50 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-quobyte-8e9285e9-36bd-4bf1-965e-2150f0bebeaa" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:50 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 Nov 02 10:46:50 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-8e9285e9-36bd-4bf1-965e-2150f0bebeaa" acquired by "delete_volume" :: waited 0.042s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5761987-6594-4891-9d46-ae87f37d0dc6]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:50 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Deleted volume successfully. Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-667c5d1f-b22c-4100-9a8d-a12e181b3e19 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-47c8f8c1-aa44-452a-a63b-e1bf799f18c2-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:50 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa Nov 02 10:46:50 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" returned: 0 in 0.330s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe" released by "delete_volume" :: held 0.861s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Created reservations ['7062e2b4-fa05-49c0-8cd9-547fe2843b75', 'b5ae29a7-b20b-4f2c-8b39-00d6e0da4158', '1bb4365b-54e9-4271-a8c3-b07201ab7edb', '012f5dc3-1ea6-46a1-9011-39ec37e21557'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:50 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" returned: 0 in 0.536s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 1G Nov 02 10:46:50 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:50 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:50 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:50 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa" returned: 0 in 0.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa Nov 02 10:46:51 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-8e9285e9-36bd-4bf1-965e-2150f0bebeaa" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.332s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-8e9285e9-36bd-4bf1-965e-2150f0bebeaa" released by "delete_volume" :: held 0.756s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8bf3e64d-9402-4303-aa8f-cadfb3f24e09 tempest-VolumesGetTest-733416880 None] Lock "cinder-0dbb5156-aa39-4fe5-b9a0-9ffb4ba03afe-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created reservations ['9d1bbf29-c5e0-43cc-bba3-cabb7cd9fa9c', '1fbd549d-4852-43a4-b5d9-a044b6639587', '80426818-dec2-43a3-991b-b0456270969e', '22279982-65e7-428e-b921-75365c418c3b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:51 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 1G" returned: 0 in 0.528s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:51 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 Nov 02 10:46:51 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:51 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-d4809442-7ecb-4889-803b-7d34ca7bff84-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-d4809442-7ecb-4889-803b-7d34ca7bff84-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-quobyte-d4809442-7ecb-4889-803b-7d34ca7bff84" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-d4809442-7ecb-4889-803b-7d34ca7bff84" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:51 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5" returned: 0 in 0.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 is being set with open permissions: ugo+rw Nov 02 10:46:51 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[200dd2c4-acfe-4f1c-a877-e70f18bc28c4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 Nov 02 10:46:51 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.315s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Deleted volume successfully. Nov 02 10:46:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c55bf748-fd81-4a9d-9139-a0ae30a0df98 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-8e9285e9-36bd-4bf1-965e-2150f0bebeaa-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:51 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 Nov 02 10:46:51 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5" returned: 0 in 0.255s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info Nov 02 10:46:52 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:52 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84" returned: 0 in 0.422s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84 Nov 02 10:46:52 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:52 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info" returned: 0 in 0.276s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info is being set with open permissions: ugo+rw Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info Nov 02 10:46:52 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:52 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-d4809442-7ecb-4889-803b-7d34ca7bff84" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-d4809442-7ecb-4889-803b-7d34ca7bff84" released by "delete_volume" :: held 0.745s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created reservations ['daed832d-a056-4df3-8faa-a6922e642708', '3c58e904-8d2f-4e0f-970e-a25b1de97171', '21048dcc-e3ef-4cb8-84c0-7bef4da62b32', '0c9d20fe-bafe-4b0b-8fa5-b707411f2b6e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:52 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.info" returned: 0 in 0.294s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:52 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c8e6369f-7595-4868-810d-0290bc5a19e4 tempest-VolumesSnapshotTestJSON-769721684 None] Create snapshot completed successfully Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-317f5fb6-197a-427a-81d8-6fbb319d7901-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-317f5fb6-197a-427a-81d8-6fbb319d7901-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-quobyte-317f5fb6-197a-427a-81d8-6fbb319d7901" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-317f5fb6-197a-427a-81d8-6fbb319d7901" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:52 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f1159-cfb5-4a55-a446-d8c11d723503]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.298s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (37182cad-833a-4016-b328-908473a0f59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9aaf234-8f03-4c7f-977e-bebc18ecd942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Deleted volume successfully. Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9aaf234-8f03-4c7f-977e-bebc18ecd942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-581729247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5d5d20-988b-40d9-80cd-138513dd95e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:53Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4c591e-485d-4edc-b40a-8fe0813316b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4c591e-485d-4edc-b40a-8fe0813316b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b38a24-07ff-4351-9f89-b66ba1d3349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f6742a0-43c7-426f-be6b-06ea9ede2060 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-d4809442-7ecb-4889-803b-7d34ca7bff84-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:53 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 Nov 02 10:46:53 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:53 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901" returned: 0 in 0.373s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901 Nov 02 10:46:53 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b38a24-07ff-4351-9f89-b66ba1d3349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b5d5d20-988b-40d9-80cd-138513dd95e5', 'volume_name': 'volume-2b5d5d20-988b-40d9-80cd-138513dd95e5', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ebbfac-d7b8-431e-b323-b0f40245ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ebbfac-d7b8-431e-b323-b0f40245ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce42f733-1522-4af5-9bd0-0ed1da6dd62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:53 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Volume 2b5d5d20-988b-40d9-80cd-138513dd95e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b5d5d20-988b-40d9-80cd-138513dd95e5', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Trying to clone 2b5d5d20-988b-40d9-80cd-138513dd95e5 from image 6256c21e-7619-488e-bde7-257c3f79e20b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:46:53 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-317f5fb6-197a-427a-81d8-6fbb319d7901" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-674d3ce5-0614-45a2-a440-4b99e6ca2ad5-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-317f5fb6-197a-427a-81d8-6fbb319d7901" released by "delete_volume" :: held 0.758s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-674d3ce5-0614-45a2-a440-4b99e6ca2ad5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-674d3ce5-0614-45a2-a440-4b99e6ca2ad5" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:46:53 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-674d3ce5-0614-45a2-a440-4b99e6ca2ad5" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Deleting offline snapshot 674d3ce5-0614-45a2-a440-4b99e6ca2ad5 of volume 197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] snapshot_file for this snap is: volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created reservations ['3a3fe3f3-2465-49ba-ba27-121f630cf996', '83cc9056-afad-42ed-8aee-fddc97de9729', 'f5c74d38-0793-45d8-96d2-d76e273d080e', 'ddd0aa9a-0edf-4a4a-9fa6-ae29b4b19f6a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eab1140-2890-48da-9bfe-6d4a6e8e1451]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dd3d06-97c0-4184-8532-dc31f5d38004]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 Nov 02 10:46:54 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:54 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD Nov 02 10:46:54 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:54 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b is fetched for user 15a5b3e167824b0fb98fd5192928b12e. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:46:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Deleted volume successfully. Nov 02 10:46:54 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5" returned: 0 in 0.386s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[99746204-4ca4-44ad-8643-5bf024357ee5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bac5cf2d-2665-4ca1-b6fb-68967e46ca27 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-317f5fb6-197a-427a-81d8-6fbb319d7901-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=144,cinder:UPDATE=195,cinder:INSERT=47,cinder:DELETE=21 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1873262-fcb5-424d-9625-475070cc271b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 Nov 02 10:46:54 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD Nov 02 10:46:54 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" returned: 0 in 0.369s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:54 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-581729247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5d5d20-988b-40d9-80cd-138513dd95e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:53Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Creating volume 2b5d5d20-988b-40d9-80cd-138513dd95e5 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:54 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:54 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 1073741824 Nov 02 10:46:54 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:55 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5" returned: 0 in 0.337s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-0d271e9a-579d-48f9-b587-111959f05b13-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:55 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5 Nov 02 10:46:55 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-0d271e9a-579d-48f9-b587-111959f05b13-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=148,cinder:UPDATE=207,cinder:INSERT=48,cinder:DELETE=16 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-quobyte-0d271e9a-579d-48f9-b587-111959f05b13" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-0d271e9a-579d-48f9-b587-111959f05b13" acquired by "delete_volume" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba73d7-4280-4fde-a66b-a6067f7ffa7b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:55 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 1073741824" returned: 0 in 0.462s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:55 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 Nov 02 10:46:55 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:55 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 Nov 02 10:46:55 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:55 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7.674d3ce5-0614-45a2-a440-4b99e6ca2ad5" returned: 0 in 0.284s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-674d3ce5-0614-45a2-a440-4b99e6ca2ad5" released by "_delete_snapshot" :: held 1.521s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" released by "delete_snapshot" :: held 1.569s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['bced4cbc-3eb3-419f-8583-7e59766faf0f', '2ffc7866-96a0-427d-8ccd-79a6f1301cd2', '672fc75e-6c4e-48de-9d5b-57d114e0ee29', 'd0d0a232-51c4-4042-a203-fdae24590f03'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Delete snapshot completed successfully. Nov 02 10:46:55 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5" returned: 0 in 0.272s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e29d907-7bcc-4119-9028-3962e14f0733 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-674d3ce5-0614-45a2-a440-4b99e6ca2ad5-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Attempting download of 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume 2b5d5d20-988b-40d9-80cd-138513dd95e5. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:46:55 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13" returned: 0 in 0.392s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d08f2b-addc-47ec-9e09-eb39603f94fa]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:55 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13 Nov 02 10:46:55 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:55 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih Nov 02 10:46:55 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:55 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0d271e9a-579d-48f9-b587-111959f05b13" returned: 0 in 0.277s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-0d271e9a-579d-48f9-b587-111959f05b13" released by "delete_volume" :: held 0.713s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created reservations ['b6025832-68eb-4690-be5b-f642e426a454', 'f30a6be1-0674-423d-b03a-76b3a73211c3', '82ab4f58-85b1-45b7-a671-b9a91690410f', '4ad78999-c9ce-4d67-824a-d1fbf40ffa1e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:55 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih" returned: 0 in 0.367s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:56 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:56 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:56 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih Nov 02 10:46:56 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:56 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "cinder-quobyte-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:56 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Deleted volume successfully. Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:56 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8ac76088-f612-40e0-88c2-9be205a92209 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-0d271e9a-579d-48f9-b587-111959f05b13-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih" returned: 1 in 0.465s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_riqjshih' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b8040-416f-4d95-aa83-c4eca11d253b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7aa103-b646-4708-bbf2-d61ea940ade2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (c64c22a1-b11a-4533-972d-f1b0a9ba7f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83a8914-2ab6-4acf-b71d-6f792c5dd82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83a8914-2ab6-4acf-b71d-6f792c5dd82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-626422074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feebcbbb-45c8-4514-9a1e-e56fafd035c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:56Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb505e3-f9ff-4b41-9d9d-5941d1ef8ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb505e3-f9ff-4b41-9d9d-5941d1ef8ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:56 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD Nov 02 10:46:56 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8fdd9d-3e8b-49a8-add2-cd8d0e651e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8fdd9d-3e8b-49a8-add2-cd8d0e651e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feebcbbb-45c8-4514-9a1e-e56fafd035c9', 'volume_name': 'volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a6d8c0-9e52-4e22-bfee-a5eef8eb677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a6d8c0-9e52-4e22-bfee-a5eef8eb677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:56 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e Nov 02 10:46:56 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6527f59e-c4b0-4c72-8523-5ee0eccb47f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:56 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Volume feebcbbb-45c8-4514-9a1e-e56fafd035c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9', 'volume_size': 1} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-626422074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feebcbbb-45c8-4514-9a1e-e56fafd035c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:56Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Creating volume feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:56 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:56 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 1073741824 Nov 02 10:46:56 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:56 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] 6256c21e-7619-488e-bde7-257c3f79e20b was qcow2, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:56 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 Nov 02 10:46:56 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:56 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e" returned: 0 in 0.498s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:57 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e Nov 02 10:46:57 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:57 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 1073741824" returned: 0 in 0.543s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:57 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 Nov 02 10:46:57 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:57 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e" returned: 0 in 0.278s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-quobyte-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e" released by "delete_volume" :: held 0.845s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Created reservations ['4724ae4b-56f5-4ec5-a29e-ecc5df7e3637', '44a8fe24-a7f0-4274-bc18-1f40fb963264', 'e239a233-76b2-4118-bb72-4cc5715bbf64', '75ac0af5-296d-416b-98df-d8a6abc8da6f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:57 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:46:57 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:57 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6527f59e-c4b0-4c72-8523-5ee0eccb47f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8698f55-c127-4dec-978f-3768e1d4df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Volume volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 (feebcbbb-45c8-4514-9a1e-e56fafd035c9): created successfully Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8698f55-c127-4dec-978f-3768e1d4df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (c64c22a1-b11a-4533-972d-f1b0a9ba7f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fc7b45cc-b6e6-4d84-85ee-e297b87b960d tempest-VolumesSnapshotTestJSON-769721684 None] Created volume successfully. Nov 02 10:46:57 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.350s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Deleted volume successfully. Nov 02 10:46:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-05c46845-bbbe-47d4-885f-afa50a285de7 tempest-CreateVolumesFromSourceVolumeTest-531517900 None] Lock "cinder-012ba9d8-401b-4c2e-9d4d-77b2cbbe0f9e-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Creating offline snapshot 833efdee-8dfb-4f11-a4ec-78e798ae70c3 of volume feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[376beffc-cce7-476e-8f49-ce4b3d8c16a5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:58 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5" returned: 0 in 2.122s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_3ly0khzmdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:46:58 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Converted 112.00 MB image at 52.75 MB/s Nov 02 10:46:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:58 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 1G Nov 02 10:46:58 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:58 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 Nov 02 10:46:58 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:59 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9" returned: 0 in 0.381s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:59 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 1G Nov 02 10:46:59 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:59 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 1G" returned: 0 in 0.348s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Downloaded image 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume 2b5d5d20-988b-40d9-80cd-138513dd95e5 successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b for user 15a5b3e167824b0fb98fd5192928b12e is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Marking volume 2b5d5d20-988b-40d9-80cd-138513dd95e5 as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Copying metadata from image 6256c21e-7619-488e-bde7-257c3f79e20b to 2b5d5d20-988b-40d9-80cd-138513dd95e5. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Creating volume glance metadata for volume 2b5d5d20-988b-40d9-80cd-138513dd95e5 backed by image 6256c21e-7619-488e-bde7-257c3f79e20b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce42f733-1522-4af5-9bd0-0ed1da6dd62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5d5d20-988b-40d9-80cd-138513dd95e5', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7485fe86-7a47-4ef8-bceb-8027957b7510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:59 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Volume volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 (2b5d5d20-988b-40d9-80cd-138513dd95e5): created successfully Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7485fe86-7a47-4ef8-bceb-8027957b7510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (37182cad-833a-4016-b328-908473a0f59c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-cb9d4e4a-608e-4e00-84c8-bc7401372faf tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:46:59 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 1G" returned: 0 in 0.412s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:59 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 Nov 02 10:46:59 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:59 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3" returned: 0 in 0.308s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:59 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 is being set with open permissions: ugo+rw Nov 02 10:46:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:59 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 Nov 02 10:46:59 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:00 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:00 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info Nov 02 10:47:00 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:00 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:00 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info is being set with open permissions: ugo+rw Nov 02 10:47:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:00 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info Nov 02 10:47:00 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:00 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.info" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2040791f-a4ea-49e2-b363-d8fe696af2e1 tempest-VolumesSnapshotTestJSON-769721684 None] Create snapshot completed successfully Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (c93f2b0f-8911-4083-8872-da8b9eee3d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f3127e-6a10-4cf5-91d6-4e76449644f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f3127e-6a10-4cf5-91d6-4e76449644f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-709190377',display_name='tempest-VolumesGetTest-Volume-732333821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b310957-9415-42bc-9d80-ba4b2d317695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:01Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c17825-7a3d-4259-9b47-3dca7e92ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c17825-7a3d-4259-9b47-3dca7e92ebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609c6c31-09f4-4bf2-bb08-9efaa160caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609c6c31-09f4-4bf2-bb08-9efaa160caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b310957-9415-42bc-9d80-ba4b2d317695', 'volume_name': 'volume-3b310957-9415-42bc-9d80-ba4b2d317695', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf232ec-a4a3-4533-bd15-a693d16ca557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf232ec-a4a3-4533-bd15-a693d16ca557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b66a51-37a2-4a7b-be68-2b6cac8f57d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Volume 3b310957-9415-42bc-9d80-ba4b2d317695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b310957-9415-42bc-9d80-ba4b2d317695', 'volume_size': 1} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-709190377',display_name='tempest-VolumesGetTest-Volume-732333821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b310957-9415-42bc-9d80-ba4b2d317695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a05df7474b4697b9c579322f8b8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:01Z,use_quota=True,user_id='15a5b3e167824b0fb98fd5192928b12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Creating volume 3b310957-9415-42bc-9d80-ba4b2d317695 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:01 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:01 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 1073741824 Nov 02 10:47:01 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (8b38ecee-2967-437e-a43f-f58d0a0eb5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63692666-40b2-4a21-b62c-a8f10ca438a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63692666-40b2-4a21-b62c-a8f10ca438a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922743392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b521a3-1200-4101-ae1c-076c4e69d162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:01Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e2fbe6-824c-40bb-9cd5-3062464ef79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e2fbe6-824c-40bb-9cd5-3062464ef79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c59f84-162a-4740-ae28-f656c92ebe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c59f84-162a-4740-ae28-f656c92ebe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b521a3-1200-4101-ae1c-076c4e69d162', 'volume_name': 'volume-49b521a3-1200-4101-ae1c-076c4e69d162', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df42b18-fdd7-4c47-8e2f-268c44c0149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df42b18-fdd7-4c47-8e2f-268c44c0149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc422a15-73a8-4ee3-8955-669bbc73fa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Volume 49b521a3-1200-4101-ae1c-076c4e69d162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b521a3-1200-4101-ae1c-076c4e69d162', 'volume_size': 1} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (8dc8f953-63a3-4fb1-9868-d23d863252a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02932271-863f-480a-b2a9-10361aea716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02932271-863f-480a-b2a9-10361aea716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-944158478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6e3625-d869-46e2-a77f-1490ebefefe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=833efdee-8dfb-4f11-a4ec-78e798ae70c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:02Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3d8bd1-8a24-4c52-a6f2-60129fd2ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3d8bd1-8a24-4c52-a6f2-60129fd2ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b32ac9-9ef1-4022-aa81-d08cc8130ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b32ac9-9ef1-4022-aa81-d08cc8130ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be6e3625-d869-46e2-a77f-1490ebefefe3', 'volume_name': 'volume-be6e3625-d869-46e2-a77f-1490ebefefe3', 'volume_size': 2, 'snapshot_id': '833efdee-8dfb-4f11-a4ec-78e798ae70c3'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c33c8d-5438-4529-8ccb-ab57f6e05aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c33c8d-5438-4529-8ccb-ab57f6e05aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df521d-da08-4daa-a161-63aeda6b9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Volume be6e3625-d869-46e2-a77f-1490ebefefe3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be6e3625-d869-46e2-a77f-1490ebefefe3', 'volume_size': 2, 'snapshot_id': '833efdee-8dfb-4f11-a4ec-78e798ae70c3'} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 1073741824" returned: 0 in 0.526s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:01 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 Nov 02 10:47:01 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:01 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922743392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b521a3-1200-4101-ae1c-076c4e69d162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:01Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Creating volume 49b521a3-1200-4101-ae1c-076c4e69d162 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:01 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b66a51-37a2-4a7b-be68-2b6cac8f57d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b310957-9415-42bc-9d80-ba4b2d317695', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32194ebf-4c87-4898-ab98-1f93137c6d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:02 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 1073741824 Nov 02 10:47:02 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Volume volume-3b310957-9415-42bc-9d80-ba4b2d317695 (3b310957-9415-42bc-9d80-ba4b2d317695): created successfully Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32194ebf-4c87-4898-ab98-1f93137c6d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Flow 'volume_create_manager' (c93f2b0f-8911-4083-8872-da8b9eee3d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9fc80450-2c1e-4f99-9f0c-9828b01cf2b3 tempest-VolumesGetTest-733416880 None] Created volume successfully. Nov 02 10:47:02 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 1073741824" returned: 0 in 0.414s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 Nov 02 10:47:02 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:02 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-833efdee-8dfb-4f11-a4ec-78e798ae70c3-be6e3625-d869-46e2-a77f-1490ebefefe3" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc422a15-73a8-4ee3-8955-669bbc73fa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b521a3-1200-4101-ae1c-076c4e69d162', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1590f7-0eea-494a-94aa-a2a3d2d4e6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-833efdee-8dfb-4f11-a4ec-78e798ae70c3-be6e3625-d869-46e2-a77f-1490ebefefe3" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Creating volume be6e3625-d869-46e2-a77f-1490ebefefe3 from snapshot 833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-be6e3625-d869-46e2-a77f-1490ebefefe3" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Volume volume-49b521a3-1200-4101-ae1c-076c4e69d162 (49b521a3-1200-4101-ae1c-076c4e69d162): created successfully Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1590f7-0eea-494a-94aa-a2a3d2d4e6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (8b38ecee-2967-437e-a43f-f58d0a0eb5c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-be6e3625-d869-46e2-a77f-1490ebefefe3" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] snapshot: 833efdee-8dfb-4f11-a4ec-78e798ae70c3, volume: be6e3625-d869-46e2-a77f-1490ebefefe3, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:47:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a23f21cd-001c-4554-b7ed-38ea817da5c6 tempest-ProjectReaderTests-1797077714 None] Created volume successfully. Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ff19b1-8ccf-4b56-ab90-9a607fea18db]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 Nov 02 10:47:02 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3398a96-e73c-43b7-921d-d8839b8e8b92]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-3b310957-9415-42bc-9d80-ba4b2d317695-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Lock "cinder-3b310957-9415-42bc-9d80-ba4b2d317695-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-3b310957-9415-42bc-9d80-ba4b2d317695" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:03 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 Nov 02 10:47:03 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-3b310957-9415-42bc-9d80-ba4b2d317695" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a1dfc-ab83-4eda-9058-b3bc230eb34a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 Nov 02 10:47:03 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-49b521a3-1200-4101-ae1c-076c4e69d162-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-49b521a3-1200-4101-ae1c-076c4e69d162-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-quobyte-49b521a3-1200-4101-ae1c-076c4e69d162" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-49b521a3-1200-4101-ae1c-076c4e69d162" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:03 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9" returned: 0 in 0.457s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1f5f42-79d5-492f-bd3a-eaf32157a6a1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 Nov 02 10:47:03 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695" returned: 0 in 0.409s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 Nov 02 10:47:03 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695 Nov 02 10:47:03 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:04 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3b310957-9415-42bc-9d80-ba4b2d317695" returned: 0 in 0.252s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-3b310957-9415-42bc-9d80-ba4b2d317695" released by "delete_volume" :: held 0.714s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:04 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162" returned: 0 in 0.405s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Created reservations ['e0dd7cc6-3e15-47bf-af8e-76822b172add', '505397ae-9f6b-4efc-86e1-a3b48c20feea', '1282e505-5cce-403e-9116-2e321a237b42', 'db887555-1204-419b-8487-258a18ac4108'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:04 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162 Nov 02 10:47:04 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:04 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:04 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:04 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-49b521a3-1200-4101-ae1c-076c4e69d162" returned: 0 in 0.454s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-49b521a3-1200-4101-ae1c-076c4e69d162" released by "delete_volume" :: held 0.931s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-2b5d5d20-988b-40d9-80cd-138513dd95e5-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Created reservations ['7cdae34c-42c7-4721-ade8-2fe38531d48b', 'a270dcd2-4c0f-48a8-8e4a-d05e7c82e75a', '43e02100-efda-4955-97c4-b14407c3ed6a', '960e3809-bf7b-4bb2-954d-b4b387388f9a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Lock "cinder-2b5d5d20-988b-40d9-80cd-138513dd95e5-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:04 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.593s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-54d0b2ac-07ff-46ae-8aea-bb5ed51c3c9e tempest-VolumesGetTest-733416880 None] Lock "cinder-3b310957-9415-42bc-9d80-ba4b2d317695-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Acquiring lock "cinder-quobyte-2b5d5d20-988b-40d9-80cd-138513dd95e5" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-2b5d5d20-988b-40d9-80cd-138513dd95e5" acquired by "delete_volume" :: waited 0.038s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a65796d-d97d-4950-afbd-67eccf0142c4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:05 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:05 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:05 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 Nov 02 10:47:05 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:05 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.438s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Deleted volume successfully. Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-186e8e91-bdb8-4eaf-9ff4-ffd29682a664 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-49b521a3-1200-4101-ae1c-076c4e69d162-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:05 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5" returned: 0 in 0.695s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:05 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5 Nov 02 10:47:05 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:06 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2b5d5d20-988b-40d9-80cd-138513dd95e5" returned: 0 in 0.540s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Lock "cinder-quobyte-2b5d5d20-988b-40d9-80cd-138513dd95e5" released by "delete_volume" :: held 1.343s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Created reservations ['aec96413-6f72-4b7b-8e8d-06f0d672011d', '03046f92-1666-4273-a8e4-944457401983', 'f0076174-21be-485f-a9dd-1fce0803aa27', 'aef649ed-bb0f-457a-b676-373c9416f28f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:06 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:06 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (14e1b77a-5aa4-447a-a964-e89ea98374c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bf4b67-a691-44a7-a4e4-f3dbae0a872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bf4b67-a691-44a7-a4e4-f3dbae0a872b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996635484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30aebc74-e940-4dbe-937c-a51e574f958d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:07Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aadd30c-7bb7-4e37-9052-f0e26b66e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aadd30c-7bb7-4e37-9052-f0e26b66e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91353f8-ff8d-43c0-988f-38de9a4c9adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91353f8-ff8d-43c0-988f-38de9a4c9adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30aebc74-e940-4dbe-937c-a51e574f958d', 'volume_name': 'volume-30aebc74-e940-4dbe-937c-a51e574f958d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a41ab0-36bd-4dfb-881e-2251491ef354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a41ab0-36bd-4dfb-881e-2251491ef354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b11b65-9556-4f8b-a015-dce804cae324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Volume 30aebc74-e940-4dbe-937c-a51e574f958d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30aebc74-e940-4dbe-937c-a51e574f958d', 'volume_size': 1} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:06 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.407s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:06 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Deleted volume successfully. Nov 02 10:47:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aed4f565-9664-4d2e-84c6-922f3cbe6637 tempest-VolumesGetTest-733416880 None] Lock "cinder-2b5d5d20-988b-40d9-80cd-138513dd95e5-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:11 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3" returned: 0 in 7.459s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:47:11 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Converted 1024.00 MB image at 137.27 MB/s Nov 02 10:47:11 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 is being set with open permissions: ugo+rw Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 Nov 02 10:47:11 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:11 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3" returned: 0 in 0.239s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-be6e3625-d869-46e2-a77f-1490ebefefe3" released by "_copy_volume_from_snapshot" :: held 8.606s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-833efdee-8dfb-4f11-a4ec-78e798ae70c3-be6e3625-d869-46e2-a77f-1490ebefefe3" released by "_create_volume_from_snapshot" :: held 8.686s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.720s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.540s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996635484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30aebc74-e940-4dbe-937c-a51e574f958d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:07Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Creating volume 30aebc74-e940-4dbe-937c-a51e574f958d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:11 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d 1073741824 Nov 02 10:47:11 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df521d-da08-4daa-a161-63aeda6b9b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6e3625-d869-46e2-a77f-1490ebefefe3', 'volume_size': 2, 'snapshot_id': '833efdee-8dfb-4f11-a4ec-78e798ae70c3'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e450b3ab-050c-4e1e-9c1e-9c04f000f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:11 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Volume volume-be6e3625-d869-46e2-a77f-1490ebefefe3 (be6e3625-d869-46e2-a77f-1490ebefefe3): created successfully Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e450b3ab-050c-4e1e-9c1e-9c04f000f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (8dc8f953-63a3-4fb1-9868-d23d863252a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-89305d19-2597-4c35-9592-d3da6568f8bb tempest-VolumesSnapshotTestJSON-769721684 None] Created volume successfully. Nov 02 10:47:11 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d 1073741824" returned: 0 in 0.478s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d Nov 02 10:47:11 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d" returned: 0 in 0.243s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b11b65-9556-4f8b-a015-dce804cae324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30aebc74-e940-4dbe-937c-a51e574f958d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0889f0af-cbaf-4541-ba63-065403599341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:12 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Volume volume-30aebc74-e940-4dbe-937c-a51e574f958d (30aebc74-e940-4dbe-937c-a51e574f958d): created successfully Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0889f0af-cbaf-4541-ba63-065403599341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (14e1b77a-5aa4-447a-a964-e89ea98374c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-022ce10e-6bb8-4956-8ae4-fc62a14f0a74 tempest-ProjectReaderTests-1797077714 None] Created volume successfully. Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Flow 'volume_create_manager' (dd127602-197a-4b2b-8c96-f5958768544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d038860-a517-4b70-b3ef-36872005bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d038860-a517-4b70-b3ef-36872005bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1234335342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ff5a78-278f-4a1c-9605-7a1e0ab19b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26d771ea1fb45db9ac931551ee10e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:12Z,use_quota=True,user_id='b33eb62fd7de414188f3009803beb24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2932b549-5441-4c85-b9f3-245d2f81a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2932b549-5441-4c85-b9f3-245d2f81a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b03f00-e71c-4f29-bbce-f72adc94503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b03f00-e71c-4f29-bbce-f72adc94503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ff5a78-278f-4a1c-9605-7a1e0ab19b24', 'volume_name': 'volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a44853-183b-453b-a3b6-ea73354eb9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a44853-183b-453b-a3b6-ea73354eb9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04a6ecb-0521-4ba9-9318-7e9ee94088e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:12 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24', 'volume_size': 1} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1234335342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ff5a78-278f-4a1c-9605-7a1e0ab19b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26d771ea1fb45db9ac931551ee10e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:12Z,use_quota=True,user_id='b33eb62fd7de414188f3009803beb24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Creating volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:12 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 1073741824 Nov 02 10:47:12 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-be6e3625-d869-46e2-a77f-1490ebefefe3-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-be6e3625-d869-46e2-a77f-1490ebefefe3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-be6e3625-d869-46e2-a77f-1490ebefefe3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-be6e3625-d869-46e2-a77f-1490ebefefe3" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb8c601-71ed-43bd-aad7-cad0a17cfb10]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 Nov 02 10:47:12 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-30aebc74-e940-4dbe-937c-a51e574f958d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:13 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 1073741824" returned: 0 in 0.556s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-30aebc74-e940-4dbe-937c-a51e574f958d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 Nov 02 10:47:13 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-quobyte-30aebc74-e940-4dbe-937c-a51e574f958d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-30aebc74-e940-4dbe-937c-a51e574f958d" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[760585d8-898a-4a2b-abef-ded9b417963c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3" returned: 0 in 0.439s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3 Nov 02 10:47:13 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d Nov 02 10:47:13 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" returned: 0 in 0.312s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04a6ecb-0521-4ba9-9318-7e9ee94088e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9324a1-1ed0-406d-a30e-8641d3ba91c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:13 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Volume volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 (16ff5a78-278f-4a1c-9605-7a1e0ab19b24): created successfully Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9324a1-1ed0-406d-a30e-8641d3ba91c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Flow 'volume_create_manager' (dd127602-197a-4b2b-8c96-f5958768544f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e82af85a-3558-4acd-8071-3f03068f57f9 tempest-VolumesSnapshotListTestJSON-1042596774 None] Created volume successfully. Nov 02 10:47:13 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-be6e3625-d869-46e2-a77f-1490ebefefe3" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-be6e3625-d869-46e2-a77f-1490ebefefe3" released by "delete_volume" :: held 0.753s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['3c400cbf-ef6e-45ca-bf19-066a4c18ec32', 'f8e5d0da-95d1-449e-9250-036edaa823c5', 'a40fe7a8-fdec-4b36-b03d-fed4c068b352', 'ff1e8a20-3594-4dcf-aab1-cfa43ce85460'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:13 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d" returned: 0 in 0.420s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d Nov 02 10:47:13 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:13 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-30aebc74-e940-4dbe-937c-a51e574f958d" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-30aebc74-e940-4dbe-937c-a51e574f958d" released by "delete_volume" :: held 0.744s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Created reservations ['dd9d62c3-e478-4f8f-8ac3-25d9d2b74e42', 'a5c76286-7dc1-42e9-9468-fb8a315e6cba', 'd7fc596a-2698-493b-bd49-a962f1046e36', 'a4d806d8-801d-407d-9fd3-6f7616b80dce'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:13 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-833efdee-8dfb-4f11-a4ec-78e798ae70c3-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.288s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-833efdee-8dfb-4f11-a4ec-78e798ae70c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-feebcbbb-45c8-4514-9a1e-e56fafd035c9" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Deleted volume successfully. Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-feebcbbb-45c8-4514-9a1e-e56fafd035c9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-833efdee-8dfb-4f11-a4ec-78e798ae70c3" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71e26265-7035-4a0c-87fa-2cdec55439b8 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-be6e3625-d869-46e2-a77f-1490ebefefe3-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-833efdee-8dfb-4f11-a4ec-78e798ae70c3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Deleting offline snapshot 833efdee-8dfb-4f11-a4ec-78e798ae70c3 of volume feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] snapshot_file for this snap is: volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d42b83-49fa-48a9-820e-1825d9973f18]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:14 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:14 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:14 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 Nov 02 10:47:14 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:14 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.262s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Deleted volume successfully. Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-167592bc-b0a9-4db3-8f49-138cd759ccd5 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-30aebc74-e940-4dbe-937c-a51e574f958d-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:14 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3" returned: 0 in 0.456s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af26bd-d9ee-4a52-8ecf-fcdbd9638e94]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:14 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 Nov 02 10:47:14 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (9f4dc71e-73f3-415e-9905-c27143fb6e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b54f9-b3ce-4182-8f6b-0a357c71d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b54f9-b3ce-4182-8f6b-0a357c71d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364633235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e53e570-ca64-4235-8fb3-f54e09d29967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:15Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e2f691-7da2-496b-b65b-c08296f5e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e2f691-7da2-496b-b65b-c08296f5e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a228a2f0-9d05-4dd8-ad1b-0198a678f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a228a2f0-9d05-4dd8-ad1b-0198a678f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e53e570-ca64-4235-8fb3-f54e09d29967', 'volume_name': 'volume-6e53e570-ca64-4235-8fb3-f54e09d29967', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d84745-0614-40fd-9765-ec9d9b381e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d84745-0614-40fd-9765-ec9d9b381e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02419480-e870-482b-bcb5-51d79f670dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Volume 6e53e570-ca64-4235-8fb3-f54e09d29967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e53e570-ca64-4235-8fb3-f54e09d29967', 'volume_size': 1} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Creating offline snapshot 79cc8dc2-f713-4542-b4cc-25cbde0ac2ee of volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503f2cf-1118-402b-a72e-fc31e6bfa24f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 Nov 02 10:47:15 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9" returned: 0 in 0.601s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 Nov 02 10:47:15 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" returned: 0 in 0.367s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee 1G Nov 02 10:47:15 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3" returned: 0 in 0.333s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3 Nov 02 10:47:15 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9.833efdee-8dfb-4f11-a4ec-78e798ae70c3" returned: 0 in 0.275s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee 1G" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:15 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-833efdee-8dfb-4f11-a4ec-78e798ae70c3" released by "_delete_snapshot" :: held 1.813s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-feebcbbb-45c8-4514-9a1e-e56fafd035c9" released by "delete_snapshot" :: held 1.846s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:15 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['2cf48512-c40c-4c0f-9c3d-2a6fe3d5066d', 'ecb2ed46-5dfb-44c6-b183-fcdedc250f18', '9b4e5938-cafc-4934-bf7d-bfa3aa604fbe', 'b1501707-7a1e-47a2-aa74-52b502aabd13'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Delete snapshot completed successfully. Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-77c60027-9344-4d54-8d09-9b6a88922c2b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-833efdee-8dfb-4f11-a4ec-78e798ae70c3-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:16 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:16 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee is being set with open permissions: ugo+rw Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:16 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-feebcbbb-45c8-4514-9a1e-e56fafd035c9-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-feebcbbb-45c8-4514-9a1e-e56fafd035c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-feebcbbb-45c8-4514-9a1e-e56fafd035c9" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-feebcbbb-45c8-4514-9a1e-e56fafd035c9" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122af4b-19b9-450c-a3fc-33cfc3166387]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.260s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info Nov 02 10:47:16 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 Nov 02 10:47:16 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info" returned: 0 in 0.247s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:16 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info is being set with open permissions: ugo+rw Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info Nov 02 10:47:16 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9" returned: 0 in 0.400s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9 Nov 02 10:47:16 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.info" returned: 0 in 0.260s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.947s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364633235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e53e570-ca64-4235-8fb3-f54e09d29967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:15Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Creating volume 6e53e570-ca64-4235-8fb3-f54e09d29967 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:16 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 1073741824 Nov 02 10:47:16 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-feebcbbb-45c8-4514-9a1e-e56fafd035c9" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-feebcbbb-45c8-4514-9a1e-e56fafd035c9" released by "delete_volume" :: held 0.744s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7d2b2127-74f4-4f34-9fae-91a8084d3570 tempest-VolumesSnapshotListTestJSON-1042596774 None] Create snapshot completed successfully Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['66ea054e-e985-4d4d-893c-8621b0e5b8e8', '5a39ed9b-1201-478b-9b48-d3fa15e41ee0', '933fc726-4bbd-4d1d-ac26-af4f535214ff', '5bd2f7cf-9e23-447f-b66f-45f1c8b92bad'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:17 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:17 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:17 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Deleted volume successfully. Nov 02 10:47:17 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 1073741824" returned: 0 in 0.511s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0239d122-aba1-4b83-b706-aa256161a1eb tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-feebcbbb-45c8-4514-9a1e-e56fafd035c9-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:17 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 Nov 02 10:47:17 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:17 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02419480-e870-482b-bcb5-51d79f670dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e53e570-ca64-4235-8fb3-f54e09d29967', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d09cbb-0b48-4c42-a339-6977cc2b2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:17 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Volume volume-6e53e570-ca64-4235-8fb3-f54e09d29967 (6e53e570-ca64-4235-8fb3-f54e09d29967): created successfully Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d09cbb-0b48-4c42-a339-6977cc2b2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (9f4dc71e-73f3-415e-9905-c27143fb6e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-817ebabc-c8a2-4f51-a41a-ec9f182ba28a tempest-ProjectReaderTests-1797077714 None] Created volume successfully. Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (43da5595-1d6c-46ea-864f-6c49aded1dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4e077d-7829-4553-8fd2-a9db248e7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4e077d-7829-4553-8fd2-a9db248e7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1421884719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf70a50-cd5d-45f1-8c4d-b0d81f680636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:18Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42423133-0cab-4b78-8d56-0a09e3adb4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42423133-0cab-4b78-8d56-0a09e3adb4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7273a820-0c44-455c-b006-797247277aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7273a820-0c44-455c-b006-797247277aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf70a50-cd5d-45f1-8c4d-b0d81f680636', 'volume_name': 'volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06eb5210-4d1f-4e50-8aa0-4f9d211e9ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06eb5210-4d1f-4e50-8aa0-4f9d211e9ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9084c1-c0e2-4b1b-9629-7a3b9249bb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:18 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Volume 0cf70a50-cd5d-45f1-8c4d-b0d81f680636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636', 'volume_size': 1} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1421884719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf70a50-cd5d-45f1-8c4d-b0d81f680636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:18Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Creating volume 0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:18 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:18 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 1073741824 Nov 02 10:47:18 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:18 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 1073741824" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:18 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 Nov 02 10:47:18 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:18 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.676s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9084c1-c0e2-4b1b-9629-7a3b9249bb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb5a486-3896-49bf-87c5-e217400617b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Creating offline snapshot 9cba7513-5564-408a-b2cf-213d84f0773e of volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:47:18 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Volume volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 (0cf70a50-cd5d-45f1-8c4d-b0d81f680636): created successfully Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb5a486-3896-49bf-87c5-e217400617b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (43da5595-1d6c-46ea-864f-6c49aded1dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2b83ca-b334-4c36-8051-c40c38350513]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0827b88b-9988-45eb-944e-92931504ab59 tempest-VolumesSnapshotTestJSON-769721684 None] Created volume successfully. Nov 02 10:47:19 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:19 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-6e53e570-ca64-4235-8fb3-f54e09d29967-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-6e53e570-ca64-4235-8fb3-f54e09d29967-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-quobyte-6e53e570-ca64-4235-8fb3-f54e09d29967" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-6e53e570-ca64-4235-8fb3-f54e09d29967" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36e59d7-fd84-4b76-9067-579f635b7d99]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:19 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.473s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:19 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 Nov 02 10:47:19 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:19 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e 1G Nov 02 10:47:19 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:19 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:19 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967 Nov 02 10:47:19 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:19 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e 1G" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:19 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:19 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:19 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6e53e570-ca64-4235-8fb3-f54e09d29967" returned: 0 in 0.275s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-6e53e570-ca64-4235-8fb3-f54e09d29967" released by "delete_volume" :: held 0.685s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Created reservations ['afc4a607-aa1c-4c5e-8615-ea541f91b295', '400672f5-889e-48e4-adc7-ef613ee29760', '9f06267b-d962-4e46-a6ae-3cab291e444a', '80849c10-f47b-49eb-9da4-5cb335afaf9b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:20 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:20 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:20 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.304s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:20 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e is being set with open permissions: ugo+rw Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:20 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:20 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:20 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:20 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Deleted volume successfully. Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f0fce454-3987-4683-94e6-4fc4d4348b62 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-6e53e570-ca64-4235-8fb3-f54e09d29967-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:20 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.269s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.655s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.212s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Creating offline snapshot 9682dc87-8f52-425d-b405-d4c07549af9c of volume 0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:47:20 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5efef625-797a-41a7-a944-87ff57dae89a tempest-VolumesSnapshotListTestJSON-1042596774 None] Create snapshot completed successfully Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26d33c-fad0-46f3-9dff-b26289fcd3dc]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:20 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 Nov 02 10:47:20 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (1cabbed3-6ec6-4c0a-9883-d41c57743e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2198d4bc-90a3-49d9-a1f8-6e175eb201ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2198d4bc-90a3-49d9-a1f8-6e175eb201ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24278442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09883144-c3df-43e2-991d-f23ea2968810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:21Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606fbeed-21b9-41d1-b119-b493ff689358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606fbeed-21b9-41d1-b119-b493ff689358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26980d75-2098-4911-a05d-73b1f932c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26980d75-2098-4911-a05d-73b1f932c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09883144-c3df-43e2-991d-f23ea2968810', 'volume_name': 'volume-09883144-c3df-43e2-991d-f23ea2968810', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07c1228-6cac-4c58-ba8d-7ac732b82c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07c1228-6cac-4c58-ba8d-7ac732b82c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97b01f1-a99c-4901-9f32-d89e32280a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:20 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Volume 09883144-c3df-43e2-991d-f23ea2968810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09883144-c3df-43e2-991d-f23ea2968810', 'volume_size': 1} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:20 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" returned: 0 in 0.419s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:20 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c 1G Nov 02 10:47:20 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:21 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c 1G" returned: 0 in 0.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:21 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c Nov 02 10:47:21 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:21 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c" returned: 0 in 0.289s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:21 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c is being set with open permissions: ugo+rw Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:21 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c Nov 02 10:47:21 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:21 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c" returned: 0 in 0.233s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:21 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info Nov 02 10:47:21 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:22 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info" returned: 0 in 0.234s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:22 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info is being set with open permissions: ugo+rw Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:22 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info Nov 02 10:47:22 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:22 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.info" returned: 0 in 0.240s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24278442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09883144-c3df-43e2-991d-f23ea2968810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4106273375174c97b43e93ffa2aa76c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:21Z,use_quota=True,user_id='a1f5a866977a461a961086fc8f012306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Creating volume 09883144-c3df-43e2-991d-f23ea2968810 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:22 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:22 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 1073741824 Nov 02 10:47:22 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4f77c1ef-5cce-4d2b-828f-1e19c9d6296b tempest-VolumesSnapshotTestJSON-769721684 None] Create snapshot completed successfully Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:22 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:22 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:22 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 1073741824" returned: 0 in 0.426s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:22 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.277s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:47:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:47:22 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 Nov 02 10:47:22 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:23 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810" returned: 0 in 0.234s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.654s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97b01f1-a99c-4901-9f32-d89e32280a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09883144-c3df-43e2-991d-f23ea2968810', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6923a4-f30a-4de0-b4f6-e994a378dfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Creating offline snapshot 4e99a57d-f7bf-49cb-940b-1d76173df658 of volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:47:23 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Volume volume-09883144-c3df-43e2-991d-f23ea2968810 (09883144-c3df-43e2-991d-f23ea2968810): created successfully Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6923a4-f30a-4de0-b4f6-e994a378dfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Flow 'volume_create_manager' (1cabbed3-6ec6-4c0a-9883-d41c57743e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[530c579a-a911-460d-92ea-55c88b070798]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-41824dab-5dad-42c5-9581-0157a95d31ee tempest-ProjectReaderTests-1797077714 None] Created volume successfully. Nov 02 10:47:23 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:23 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:23 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:23 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 1G Nov 02 10:47:23 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (beef1f74-e1db-4452-880e-1ae415f8c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df72bcd-6d5d-4afb-ad6c-f8d6199b7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df72bcd-6d5d-4afb-ad6c-f8d6199b7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-330193499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5ce01f-98e2-4625-9a56-1d8238f83267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7f7060e83481f8f5aaf75aa59c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9682dc87-8f52-425d-b405-d4c07549af9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:24Z,use_quota=True,user_id='b24779bf428e403b8143d56340b181c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31d7982-df2b-4c06-837f-faa99e3819c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31d7982-df2b-4c06-837f-faa99e3819c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781904dc-3218-4fda-bef6-25016c1655dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781904dc-3218-4fda-bef6-25016c1655dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e5ce01f-98e2-4625-9a56-1d8238f83267', 'volume_name': 'volume-2e5ce01f-98e2-4625-9a56-1d8238f83267', 'volume_size': 1, 'snapshot_id': '9682dc87-8f52-425d-b405-d4c07549af9c'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad521756-fe55-4db8-99d8-fa76c5b3dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad521756-fe55-4db8-99d8-fa76c5b3dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242be0b3-cb23-45e4-abfc-0ed04d734d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Volume 2e5ce01f-98e2-4625-9a56-1d8238f83267: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e5ce01f-98e2-4625-9a56-1d8238f83267', 'volume_size': 1, 'snapshot_id': '9682dc87-8f52-425d-b405-d4c07549af9c'} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-09883144-c3df-43e2-991d-f23ea2968810-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-09883144-c3df-43e2-991d-f23ea2968810-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:24 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "cinder-quobyte-09883144-c3df-43e2-991d-f23ea2968810" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 1G" returned: 0 in 0.533s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-09883144-c3df-43e2-991d-f23ea2968810" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:24 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 Nov 02 10:47:24 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb137a1-5e42-42c7-95d8-93542419ea79]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 Nov 02 10:47:24 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:24 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658" returned: 0 in 0.283s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:24 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 is being set with open permissions: ugo+rw Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 Nov 02 10:47:24 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:24 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810 Nov 02 10:47:24 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:24 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.554s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.642s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-9682dc87-8f52-425d-b405-d4c07549af9c-2e5ce01f-98e2-4625-9a56-1d8238f83267" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-9682dc87-8f52-425d-b405-d4c07549af9c-2e5ce01f-98e2-4625-9a56-1d8238f83267" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Creating volume 2e5ce01f-98e2-4625-9a56-1d8238f83267 from snapshot 9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-2e5ce01f-98e2-4625-9a56-1d8238f83267" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:24 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3b8003f7-f966-4d67-9580-9ef9f5037190 tempest-VolumesSnapshotListTestJSON-1042596774 None] Create snapshot completed successfully Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-2e5ce01f-98e2-4625-9a56-1d8238f83267" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] snapshot: 9682dc87-8f52-425d-b405-d4c07549af9c, volume: 2e5ce01f-98e2-4625-9a56-1d8238f83267, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:47:24 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-09883144-c3df-43e2-991d-f23ea2968810" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-quobyte-09883144-c3df-43e2-991d-f23ea2968810" released by "delete_volume" :: held 0.677s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1783f51-6232-4683-afac-1fbbd6eca12c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Created reservations ['72321696-4e9f-4464-8547-9ee64105237c', '58be03de-6453-45a9-9ae7-333ff3721752', '6fd80ca3-bd4d-4d38-958a-a3a4e6a3767a', '4e7c626a-6e90-4369-ba54-5fe84315061f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:24 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c Nov 02 10:47:24 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:24 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:25 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c" returned: 0 in 0.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff5618-4aa3-4fe1-abeb-648a01c0749f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:25 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Deleted volume successfully. Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-198c2d73-4a06-484d-9243-f3704c25edc6 tempest-ProjectReaderTests-1797077714 None] Lock "cinder-09883144-c3df-43e2-991d-f23ea2968810-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:25 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 Nov 02 10:47:25 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:25 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" returned: 0 in 0.406s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:47:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:25 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 Nov 02 10:47:25 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-4e99a57d-f7bf-49cb-940b-1d76173df658-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-4e99a57d-f7bf-49cb-940b-1d76173df658-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-4e99a57d-f7bf-49cb-940b-1d76173df658" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-4e99a57d-f7bf-49cb-940b-1d76173df658" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Deleting offline snapshot 4e99a57d-f7bf-49cb-940b-1d76173df658 of volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] snapshot_file for this snap is: volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821b9b2-3f83-448e-89e4-e8fe890e46de]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:27 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 Nov 02 10:47:27 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:28 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658" returned: 0 in 0.751s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b438ae-d695-426f-9d42-08f0795157dc]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:28 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:28 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:29 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.603s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:29 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 Nov 02 10:47:29 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:29 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658" returned: 0 in 0.871s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:29 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658 Nov 02 10:47:29 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:30 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.4e99a57d-f7bf-49cb-940b-1d76173df658" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-4e99a57d-f7bf-49cb-940b-1d76173df658" released by "_delete_snapshot" :: held 2.842s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" released by "delete_snapshot" :: held 2.877s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Created reservations ['47bd833b-256e-4f6b-a895-918a152ca380', 'fe6b685c-8cd2-4279-84cf-0f2477f3d4e6', '9bdb7969-2628-412d-809a-1167e0dd57df', '557a9780-a613-4b4a-885b-743f0ddd4dc3'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Delete snapshot completed successfully. Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6859f67d-d7b8-4300-bc84-ce093b9e3036 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-4e99a57d-f7bf-49cb-940b-1d76173df658-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-9cba7513-5564-408a-b2cf-213d84f0773e-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-9cba7513-5564-408a-b2cf-213d84f0773e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-9cba7513-5564-408a-b2cf-213d84f0773e" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-9cba7513-5564-408a-b2cf-213d84f0773e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Deleting offline snapshot 9cba7513-5564-408a-b2cf-213d84f0773e of volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] snapshot_file for this snap is: volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[075fc4d2-6f44-47a2-877c-6d9c153c42a2]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:31 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:31 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:31 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.522s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1053bb-9a51-41a7-881c-227aad62405b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:31 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:31 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:32 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.673s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:32 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:32 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:32 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.655s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:32 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e Nov 02 10:47:32 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:32 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267" returned: 0 in 7.199s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:47:32 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Converted 1024.00 MB image at 142.22 MB/s Nov 02 10:47:32 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 is being set with open permissions: ugo+rw Nov 02 10:47:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:32 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 Nov 02 10:47:32 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:33 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.9cba7513-5564-408a-b2cf-213d84f0773e" returned: 0 in 0.234s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-9cba7513-5564-408a-b2cf-213d84f0773e" released by "_delete_snapshot" :: held 2.253s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:33 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267" returned: 0 in 0.235s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" released by "delete_snapshot" :: held 2.285s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-2e5ce01f-98e2-4625-9a56-1d8238f83267" released by "_copy_volume_from_snapshot" :: held 8.337s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-9682dc87-8f52-425d-b405-d4c07549af9c-2e5ce01f-98e2-4625-9a56-1d8238f83267" released by "_create_volume_from_snapshot" :: held 8.421s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.449s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Created reservations ['c906ada9-a137-474e-b3bf-b502536800b0', '8bc9bff8-177a-4e74-9a20-deddae5e8cdc', 'a8347828-a4d3-4d35-83ab-16d1dc296699', 'eb553796-4101-4c72-bf83-8f7a0eceefd9'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242be0b3-cb23-45e4-abfc-0ed04d734d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5ce01f-98e2-4625-9a56-1d8238f83267', 'volume_size': 1, 'snapshot_id': '9682dc87-8f52-425d-b405-d4c07549af9c'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61100ca-6365-4233-92ed-52bcb9240449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:33 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Volume volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 (2e5ce01f-98e2-4625-9a56-1d8238f83267): created successfully Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61100ca-6365-4233-92ed-52bcb9240449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Flow 'volume_create_manager' (beef1f74-e1db-4452-880e-1ae415f8c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-da93e81e-7532-45ba-b5dd-284bcff9aabd tempest-VolumesSnapshotTestJSON-769721684 None] Created volume successfully. Nov 02 10:47:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Delete snapshot completed successfully. Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ff5b09ff-0083-435f-a58a-6e6fabd700aa tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-9cba7513-5564-408a-b2cf-213d84f0773e-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-2e5ce01f-98e2-4625-9a56-1d8238f83267-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-2e5ce01f-98e2-4625-9a56-1d8238f83267-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-2e5ce01f-98e2-4625-9a56-1d8238f83267" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-2e5ce01f-98e2-4625-9a56-1d8238f83267" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e7e4b0-5750-404a-be73-8e1d056941d3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-79cc8dc2-f713-4542-b4cc-25cbde0ac2ee-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-79cc8dc2-f713-4542-b4cc-25cbde0ac2ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:33 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 Nov 02 10:47:33 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Deleting offline snapshot 79cc8dc2-f713-4542-b4cc-25cbde0ac2ee of volume 16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] snapshot_file for this snap is: volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc63ed5-f31f-4e91-bca0-04ccd19bfdc0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:34 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267" returned: 0 in 0.379s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267 Nov 02 10:47:34 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.365s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc2568d-daf5-4d06-92f8-1183d3446a7a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e5ce01f-98e2-4625-9a56-1d8238f83267" returned: 0 in 0.275s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-2e5ce01f-98e2-4625-9a56-1d8238f83267" released by "delete_volume" :: held 0.695s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:34 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 Nov 02 10:47:34 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['de6538be-2747-4a2c-a8ff-2d87d54c19d4', 'ac336964-22c4-497a-90a1-874b1fbd782f', 'e56e8a63-d350-4588-986c-108ff827cba5', '51260c26-f2a7-4b0c-b016-2d920139112b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:34 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" returned: 0 in 0.364s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:34 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Deleted volume successfully. Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-74c15182-4d61-4924-b7d5-e9d4b628d410 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-2e5ce01f-98e2-4625-9a56-1d8238f83267-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-9682dc87-8f52-425d-b405-d4c07549af9c-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-9682dc87-8f52-425d-b405-d4c07549af9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-9682dc87-8f52-425d-b405-d4c07549af9c" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-9682dc87-8f52-425d-b405-d4c07549af9c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Deleting offline snapshot 9682dc87-8f52-425d-b405-d4c07549af9c of volume 0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] snapshot_file for this snap is: volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78310c-efd2-4868-ba67-04b712837f3b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:35 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:35 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c Nov 02 10:47:35 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:35 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee Nov 02 10:47:35 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:35 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24.79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" returned: 0 in 0.253s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40df69-942f-41a4-9f86-e4107640c06b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-79cc8dc2-f713-4542-b4cc-25cbde0ac2ee" released by "_delete_snapshot" :: held 1.521s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" released by "delete_snapshot" :: held 1.548s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Created reservations ['9f0d9b47-a2cc-4105-8174-45e16fcb48a5', 'd4b100ce-48fe-4d50-87b1-fb3389718c61', '53a8689b-15af-4b80-a05d-437fafa48a7e', 'e4f2fea4-3bf2-4ee4-877b-7ad3e99267d0'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:35 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 Nov 02 10:47:35 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Delete snapshot completed successfully. Nov 02 10:47:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-daefc8a5-4109-41f4-99db-a7ff59b3680b tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-79cc8dc2-f713-4542-b4cc-25cbde0ac2ee-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:36 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" returned: 0 in 0.561s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:36 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c Nov 02 10:47:36 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-16ff5a78-278f-4a1c-9605-7a1e0ab19b24-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-16ff5a78-278f-4a1c-9605-7a1e0ab19b24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d25fa-af50-4607-bd91-31a168f77548]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:36 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:36 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 Nov 02 10:47:36 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:36 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c Nov 02 10:47:36 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:36 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636.9682dc87-8f52-425d-b405-d4c07549af9c" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:36 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-9682dc87-8f52-425d-b405-d4c07549af9c" released by "_delete_snapshot" :: held 1.673s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" released by "delete_snapshot" :: held 1.705s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:36 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24 Nov 02 10:47:36 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['6a9414bb-b5cf-465c-9fe0-77bb7afcc9cc', 'ab0b55ec-5fe5-4593-8b89-207b29c84401', '2cb32c58-3aff-40ab-853a-9e53fbd40727', '7555bdd6-82fe-41c0-8260-d6a44ef66f1f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Delete snapshot completed successfully. Nov 02 10:47:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-484750cb-3bdb-49aa-ae8b-646f58e38a77 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-9682dc87-8f52-425d-b405-d4c07549af9c-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:36 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" returned: 0 in 0.288s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-quobyte-16ff5a78-278f-4a1c-9605-7a1e0ab19b24" released by "delete_volume" :: held 0.767s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Created reservations ['9e21d194-dcfe-49f9-895e-74da2b169a8d', '38a8c68d-0b4f-47e7-9569-8c0736bd2c3b', 'ee3af852-c007-4542-ae20-3f6caae8eac6', '50345cdd-9e86-4f9f-92fd-194e7fc2d2ce'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:37 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:37 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-0cf70a50-cd5d-45f1-8c4d-b0d81f680636-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-0cf70a50-cd5d-45f1-8c4d-b0d81f680636-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd13fce-5247-4a0f-8798-4272aa242248]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:37 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.301s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Deleted volume successfully. Nov 02 10:47:37 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 Nov 02 10:47:37 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fcb94d4f-76d9-4838-af6d-6040280117e7 tempest-VolumesSnapshotListTestJSON-1042596774 None] Lock "cinder-16ff5a78-278f-4a1c-9605-7a1e0ab19b24-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:37 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" returned: 0 in 0.400s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:37 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636 Nov 02 10:47:37 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:38 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-0cf70a50-cd5d-45f1-8c4d-b0d81f680636" released by "delete_volume" :: held 0.722s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['83a87fc3-6e27-408b-92ee-d04bc1ceb61a', '4a7fd908-9e0b-42f3-a06a-768da9e6a63b', '2dbc0b25-00e0-40b1-ae98-3408663a724a', '729b55bb-873f-465f-82f0-b17dd07cb323'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:38 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:38 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:38 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Deleted volume successfully. Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0192978a-220d-4463-880a-a4294577db18 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-0cf70a50-cd5d-45f1-8c4d-b0d81f680636-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-197fc9b6-7546-4a34-8443-e2d9f0fb07d7-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-197fc9b6-7546-4a34-8443-e2d9f0fb07d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "cinder-quobyte-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b5be0-ab53-41e6-b8f0-c68868252171]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:38 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 Nov 02 10:47:38 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:39 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" returned: 0 in 0.411s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:39 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7 Nov 02 10:47:39 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:39 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" returned: 0 in 0.291s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-quobyte-197fc9b6-7546-4a34-8443-e2d9f0fb07d7" released by "delete_volume" :: held 0.778s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Created reservations ['608a5024-20f1-4f77-b486-232e14842a91', '44e42d70-c5a9-4518-ba6c-2da763ac1022', '53af470f-688a-4051-8679-d151f845cc5e', '0a0f9b15-1938-4689-95e9-ae5a6395d438'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:39 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:47:39 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:39 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Deleted volume successfully. Nov 02 10:47:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-d3ccfa86-2e5b-4455-bf36-25f478e34380 tempest-VolumesSnapshotTestJSON-769721684 None] Lock "cinder-197fc9b6-7546-4a34-8443-e2d9f0fb07d7-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:49 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=201,cinder:SELECT=143,cinder:INSERT=54,cinder:DELETE=13 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:49 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=151,cinder:UPDATE=171,cinder:INSERT=52,cinder:DELETE=17 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Flow 'volume_create_manager' (78ac549c-330c-4701-af3b-faaae71ccb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32578de8-b19b-4d4b-8e61-ca276027fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32578de8-b19b-4d4b-8e61-ca276027fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1765132824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b655c73a-b7a4-4f6b-acac-cf09f3c9499a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7711448203d841a4807116d241e096ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:04Z,use_quota=True,user_id='2bbea3da29c946049d887a766a789ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eaacdd3-c404-4d20-8ccb-d9845ea5825b),volume_type_id=0eaacdd3-c404-4d20-8ccb-d9845ea5825b)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6ad98b-9d3b-4824-a011-feaad4d5c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6ad98b-9d3b-4824-a011-feaad4d5c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cac397-69be-4d29-a673-9c938b61d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cac397-69be-4d29-a673-9c938b61d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b655c73a-b7a4-4f6b-acac-cf09f3c9499a', 'volume_name': 'volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe596ea1-f676-4bf7-a699-c9ac9ad3475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe596ea1-f676-4bf7-a699-c9ac9ad3475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb583fe-2331-4184-96d3-4fc037f04bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Volume b655c73a-b7a4-4f6b-acac-cf09f3c9499a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a', 'volume_size': 1} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1765132824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b655c73a-b7a4-4f6b-acac-cf09f3c9499a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7711448203d841a4807116d241e096ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:04Z,use_quota=True,user_id='2bbea3da29c946049d887a766a789ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eaacdd3-c404-4d20-8ccb-d9845ea5825b),volume_type_id=0eaacdd3-c404-4d20-8ccb-d9845ea5825b)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Creating volume b655c73a-b7a4-4f6b-acac-cf09f3c9499a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:04 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a 1073741824 Nov 02 10:48:04 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Flow 'volume_create_manager' (66680754-3f3d-4182-8af4-357aedb68612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0bbfb6-4893-47f4-b2fe-f7f6f26463ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0bbfb6-4893-47f4-b2fe-f7f6f26463ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-378433311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bfeac8-2191-4983-ab80-be061a0aea9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7711448203d841a4807116d241e096ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:05Z,use_quota=True,user_id='2bbea3da29c946049d887a766a789ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c81da23c-1efd-422f-aec5-aac6cfe09d02),volume_type_id=c81da23c-1efd-422f-aec5-aac6cfe09d02)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b5c359-2106-4045-8dc9-ffb16ee06c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b5c359-2106-4045-8dc9-ffb16ee06c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c6f8d-8e41-4c74-82de-cc31141561fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c6f8d-8e41-4c74-82de-cc31141561fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bfeac8-2191-4983-ab80-be061a0aea9e', 'volume_name': 'volume-c6bfeac8-2191-4983-ab80-be061a0aea9e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6a7b0e-95f5-4bf8-b183-5ffd0604be32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6a7b0e-95f5-4bf8-b183-5ffd0604be32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b685e18-a51e-466b-a617-55dfe815608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Volume c6bfeac8-2191-4983-ab80-be061a0aea9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bfeac8-2191-4983-ab80-be061a0aea9e', 'volume_size': 1} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:05 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a 1073741824" returned: 0 in 0.538s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:05 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a Nov 02 10:48:05 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:05 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a" returned: 0 in 0.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-378433311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bfeac8-2191-4983-ab80-be061a0aea9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7711448203d841a4807116d241e096ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:05Z,use_quota=True,user_id='2bbea3da29c946049d887a766a789ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c81da23c-1efd-422f-aec5-aac6cfe09d02),volume_type_id=c81da23c-1efd-422f-aec5-aac6cfe09d02)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Creating volume c6bfeac8-2191-4983-ab80-be061a0aea9e {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:05 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:05 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e 1073741824 Nov 02 10:48:05 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb583fe-2331-4184-96d3-4fc037f04bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a5d52-7b88-4f6b-8204-87329d405e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Volume volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a (b655c73a-b7a4-4f6b-acac-cf09f3c9499a): created successfully Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a5d52-7b88-4f6b-8204-87329d405e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Flow 'volume_create_manager' (78ac549c-330c-4701-af3b-faaae71ccb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ef742d83-237b-4a36-9bd7-cc2727ea2267 tempest-TestInstancesWithCinderVolumes-601508907 None] Created volume successfully. Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Flow 'volume_create_manager' (e4053db3-7229-481a-b176-5edb0377d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca30da83-48b8-47a0-90a0-d8bd29fc21a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca30da83-48b8-47a0-90a0-d8bd29fc21a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-847494557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7711448203d841a4807116d241e096ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:06Z,use_quota=True,user_id='2bbea3da29c946049d887a766a789ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6eceb62-3e5e-4d03-b5b9-02ff50c3bf0d),volume_type_id=c6eceb62-3e5e-4d03-b5b9-02ff50c3bf0d)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde4092b-60e1-486f-ab33-22a9a194f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde4092b-60e1-486f-ab33-22a9a194f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9c42ac-4f9a-45aa-8e64-c9f98f8bd8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9c42ac-4f9a-45aa-8e64-c9f98f8bd8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c', 'volume_name': 'volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c', 'volume_size': 1, 'image_id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1821920664', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7711448203d841a4807116d241e096ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'created_at': datetime.datetime(2026, 11, 2, 9, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2/file', 'properties': {}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735734bf-5f0d-46e9-9e64-3b65d1aae313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735734bf-5f0d-46e9-9e64-3b65d1aae313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db3f23b-25e0-4a57-8678-6ae7861a2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Volume a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c', 'volume_size': 1, 'image_id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1821920664', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7711448203d841a4807116d241e096ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'created_at': datetime.datetime(2026, 11, 2, 9, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2/file', 'properties': {}}, 'image_service': } Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Trying to clone a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c from image c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:48:06 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e 1073741824" returned: 0 in 0.509s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:06 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e Nov 02 10:48:06 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:06 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e" returned: 0 in 0.261s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b685e18-a51e-466b-a617-55dfe815608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bfeac8-2191-4983-ab80-be061a0aea9e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a878b5-2425-4ca8-a456-a1fbdc32ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Volume volume-c6bfeac8-2191-4983-ab80-be061a0aea9e (c6bfeac8-2191-4983-ab80-be061a0aea9e): created successfully Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a878b5-2425-4ca8-a456-a1fbdc32ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Flow 'volume_create_manager' (66680754-3f3d-4182-8af4-357aedb68612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ef80a1dc-3858-4274-a345-e87a3a9321cc tempest-TestInstancesWithCinderVolumes-601508907 None] Created volume successfully. Nov 02 10:48:09 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD, size 20.69 MB, duration 3.60 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:48:09 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Image download 20.69 MB at 5.75 MB/s Nov 02 10:48:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e77751f-a2b5-4b4a-9c74-bb15027bda9d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:09 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD Nov 02 10:48:09 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:10 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Temporary image c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 is fetched for user 2bbea3da29c946049d887a766a789ea5. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[50faced8-9b7d-47a2-b5b3-a7ddfd11d40a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:10 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD Nov 02 10:48:10 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:10 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-847494557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7711448203d841a4807116d241e096ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:06Z,use_quota=True,user_id='2bbea3da29c946049d887a766a789ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6eceb62-3e5e-4d03-b5b9-02ff50c3bf0d),volume_type_id=c6eceb62-3e5e-4d03-b5b9-02ff50c3bf0d)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Creating volume a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:10 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:48:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:10 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c 1073741824 Nov 02 10:48:10 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:11 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c 1073741824" returned: 0 in 0.516s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:11 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c Nov 02 10:48:11 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:11 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Attempting download of c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'metadata': {}}])) to volume a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b8f8d-f15f-46a2-8486-e3cbb41b7117]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:11 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d Nov 02 10:48:11 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:11 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d" returned: 0 in 0.359s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:11 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d Nov 02 10:48:11 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:12 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d" returned: 1 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_00xtyz4d' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53d462-b928-4a31-8540-0ad5f6771fd7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:12 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD Nov 02 10:48:12 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:12 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 was qcow2, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:12 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c Nov 02 10:48:12 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:14 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" returned: 0 in 1.878s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2_dvz6n3b2devstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:48:14 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Converted 112.00 MB image at 59.61 MB/s Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:14 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c 1G Nov 02 10:48:14 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:14 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c 1G" returned: 0 in 0.328s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Downloaded image c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'metadata': {}}])) to volume a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Temporary image c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 for user 2bbea3da29c946049d887a766a789ea5 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Marking volume a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Copying metadata from image c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 to a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Creating volume glance metadata for volume a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c backed by image c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2 with: {'image_id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'image_name': 'tempest-scenario-img--1821920664', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db3f23b-25e0-4a57-8678-6ae7861a2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c', 'volume_size': 1, 'image_id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1821920664', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7711448203d841a4807116d241e096ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2', 'created_at': datetime.datetime(2026, 11, 2, 9, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4274fe1-a7ec-4950-ba9d-2ee4cf0884c2/file', 'properties': {}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff1025f-ba71-45d1-af2d-320935a62519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:14 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Volume volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c (a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c): created successfully Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff1025f-ba71-45d1-af2d-320935a62519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Flow 'volume_create_manager' (e4053db3-7229-481a-b176-5edb0377d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-99b317a2-03ad-48fb-a5da-7c0b5a258fa1 tempest-TestInstancesWithCinderVolumes-601508907 None] Created volume successfully. Nov 02 10:48:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-b9882bec-86e3-44c1-86e2-0e1e38383b2f req-9719c4bc-2414-4093-9464-bc905e2c3229 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-b9882bec-86e3-44c1-86e2-0e1e38383b2f req-9719c4bc-2414-4093-9464-bc905e2c3229 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-b9882bec-86e3-44c1-86e2-0e1e38383b2f req-9719c4bc-2414-4093-9464-bc905e2c3229 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:18 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-b9882bec-86e3-44c1-86e2-0e1e38383b2f req-9719c4bc-2414-4093-9464-bc905e2c3229 tempest-TestInstancesWithCinderVolumes-601508907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '304e34e4-6a7a-4fb5-9a36-9f5c683986be', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:48:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-b9882bec-86e3-44c1-86e2-0e1e38383b2f req-9719c4bc-2414-4093-9464-bc905e2c3229 tempest-TestInstancesWithCinderVolumes-601508907 None] attachment_update completed successfully. Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:22 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:48:22 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:23 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.556s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:48:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:48:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Flow 'volume_create_manager' (62f657e4-6fe1-4faf-b61c-4a5f10101a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677a60b8-1c77-43f7-a4c1-85f357875c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677a60b8-1c77-43f7-a4c1-85f357875c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1866467160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db2b32-e2d9-4627-ad0d-813681a27ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3330ea0b4a2489f9fe24966b07e1f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:24Z,use_quota=True,user_id='8b7366ee2f154fdc9998ba4b6fe47ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b44d22d-da56-40b2-bc6a-98e502244ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b44d22d-da56-40b2-bc6a-98e502244ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea53559-dff0-4594-acd0-c44933c5dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea53559-dff0-4594-acd0-c44933c5dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05db2b32-e2d9-4627-ad0d-813681a27ed7', 'volume_name': 'volume-05db2b32-e2d9-4627-ad0d-813681a27ed7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c7a518-dd5f-43c2-ab1f-85b8d9555354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c7a518-dd5f-43c2-ab1f-85b8d9555354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928067e4-ad25-43b8-b838-6884642bc944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Volume 05db2b32-e2d9-4627-ad0d-813681a27ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05db2b32-e2d9-4627-ad0d-813681a27ed7', 'volume_size': 1} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1866467160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db2b32-e2d9-4627-ad0d-813681a27ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3330ea0b4a2489f9fe24966b07e1f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:24Z,use_quota=True,user_id='8b7366ee2f154fdc9998ba4b6fe47ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Creating volume 05db2b32-e2d9-4627-ad0d-813681a27ed7 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:24 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:48:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:24 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 1073741824 Nov 02 10:48:24 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:25 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 1073741824" returned: 0 in 0.591s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:25 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 Nov 02 10:48:25 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:25 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928067e4-ad25-43b8-b838-6884642bc944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05db2b32-e2d9-4627-ad0d-813681a27ed7', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61f5278-cd5b-4b69-aa87-14981465d7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:25 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Volume volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 (05db2b32-e2d9-4627-ad0d-813681a27ed7): created successfully Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61f5278-cd5b-4b69-aa87-14981465d7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:25 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Flow 'volume_create_manager' (62f657e4-6fe1-4faf-b61c-4a5f10101a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3016e3ce-833f-46fe-bf2a-256b9ca9e713 tempest-TestMinimumBasicScenario-671986504 None] Created volume successfully. Nov 02 10:48:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-9c855b77-8aaa-4dbc-94b0-b531fa000c61 req-ffa8d462-9c30-4235-a44d-58d49cae7ae3 tempest-TestMinimumBasicScenario-671986504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-9c855b77-8aaa-4dbc-94b0-b531fa000c61 req-ffa8d462-9c30-4235-a44d-58d49cae7ae3 tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-9c855b77-8aaa-4dbc-94b0-b531fa000c61 req-ffa8d462-9c30-4235-a44d-58d49cae7ae3 tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:28 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-9c855b77-8aaa-4dbc-94b0-b531fa000c61 req-ffa8d462-9c30-4235-a44d-58d49cae7ae3 tempest-TestMinimumBasicScenario-671986504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-05db2b32-e2d9-4627-ad0d-813681a27ed7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edf7e89e-f13d-4212-8dc7-0cfd1456a772', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:48:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-9c855b77-8aaa-4dbc-94b0-b531fa000c61 req-ffa8d462-9c30-4235-a44d-58d49cae7ae3 tempest-TestMinimumBasicScenario-671986504 None] attachment_update completed successfully. Nov 02 10:48:38 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=16,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:38 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=27,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-474aa74a-a84c-4218-966f-19a42d2dea3a req-5683a862-a688-4879-a94f-af02d5be8c63 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-474aa74a-a84c-4218-966f-19a42d2dea3a req-5683a862-a688-4879-a94f-af02d5be8c63 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-474aa74a-a84c-4218-966f-19a42d2dea3a req-5683a862-a688-4879-a94f-af02d5be8c63 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-474aa74a-a84c-4218-966f-19a42d2dea3a req-5683a862-a688-4879-a94f-af02d5be8c63 tempest-TestInstancesWithCinderVolumes-601508907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c05309c9-2bf6-40b9-a83d-29c9a8429248', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:48:56 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-474aa74a-a84c-4218-966f-19a42d2dea3a req-5683a862-a688-4879-a94f-af02d5be8c63 tempest-TestInstancesWithCinderVolumes-601508907 None] attachment_update completed successfully. Nov 02 10:48:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-7efc670d-d435-4309-8aa7-1a603e1e8e85 req-56af883a-0019-488f-a0b6-12477490c4d8 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-7efc670d-d435-4309-8aa7-1a603e1e8e85 req-56af883a-0019-488f-a0b6-12477490c4d8 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-7efc670d-d435-4309-8aa7-1a603e1e8e85 req-56af883a-0019-488f-a0b6-12477490c4d8 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-7efc670d-d435-4309-8aa7-1a603e1e8e85 req-56af883a-0019-488f-a0b6-12477490c4d8 tempest-TestInstancesWithCinderVolumes-601508907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-c6bfeac8-2191-4983-ab80-be061a0aea9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60dabea8-aba7-48f0-91f2-b01d52782e63', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:48:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-7efc670d-d435-4309-8aa7-1a603e1e8e85 req-56af883a-0019-488f-a0b6-12477490c4d8 tempest-TestInstancesWithCinderVolumes-601508907 None] attachment_update completed successfully. Nov 02 10:49:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-7b7f891e-c3d1-49fc-951e-0b091f97ee84 req-8d76df5a-d154-47b8-b413-6f738411571e tempest-TestInstancesWithCinderVolumes-601508907 None] Terminate volume connection completed successfully. Nov 02 10:49:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-7b7f891e-c3d1-49fc-951e-0b091f97ee84 req-8d76df5a-d154-47b8-b413-6f738411571e tempest-TestInstancesWithCinderVolumes-601508907 None] Deleting attachment c05309c9-2bf6-40b9-a83d-29c9a8429248. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "cinder-b655c73a-b7a4-4f6b-acac-cf09f3c9499a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-b655c73a-b7a4-4f6b-acac-cf09f3c9499a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "cinder-quobyte-b655c73a-b7a4-4f6b-acac-cf09f3c9499a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-quobyte-b655c73a-b7a4-4f6b-acac-cf09f3c9499a" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9c7da-7bd8-4d3d-afc8-f050e4aed1d0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:03 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a Nov 02 10:49:03 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:03 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a" returned: 0 in 0.389s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:03 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a Nov 02 10:49:03 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:04 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b655c73a-b7a4-4f6b-acac-cf09f3c9499a" returned: 0 in 0.247s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-quobyte-b655c73a-b7a4-4f6b-acac-cf09f3c9499a" released by "delete_volume" :: held 0.689s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:04 devstack cinder-volume[86926]: WARNING cinder.quota [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1292791298-433956381 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1292791298-433956381, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:04 devstack cinder-volume[86926]: WARNING cinder.quota [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1292791298-433956381 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1292791298-433956381, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Created reservations ['fdd6908d-f022-4c6d-8777-8d2d02fa8395', '53e30bf9-fb59-45f2-8b99-d77540d110c8', '47a30954-2b7d-4b58-a8f7-317735d9e3c7', '02060ea8-d21c-4d5f-a208-ad0b0efb8c16'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:04 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:49:04 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:04 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.265s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Deleted volume successfully. Nov 02 10:49:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31c43617-c6e8-4fab-a5f6-366311f27eaf tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-b655c73a-b7a4-4f6b-acac-cf09f3c9499a-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-f9e30bcf-374a-440c-a89c-381dadefd9e2 req-e5774941-9b4b-4946-9d9a-9a0db4f7e8de tempest-TestInstancesWithCinderVolumes-601508907 None] Terminate volume connection completed successfully. Nov 02 10:49:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-f9e30bcf-374a-440c-a89c-381dadefd9e2 req-e5774941-9b4b-4946-9d9a-9a0db4f7e8de tempest-TestInstancesWithCinderVolumes-601508907 None] Deleting attachment 60dabea8-aba7-48f0-91f2-b01d52782e63. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "cinder-c6bfeac8-2191-4983-ab80-be061a0aea9e-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-c6bfeac8-2191-4983-ab80-be061a0aea9e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "cinder-quobyte-c6bfeac8-2191-4983-ab80-be061a0aea9e" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-quobyte-c6bfeac8-2191-4983-ab80-be061a0aea9e" acquired by "delete_volume" :: waited 0.013s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793e2fb-1b48-4cfb-8484-2263288a9ac0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:07 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e Nov 02 10:49:07 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:07 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e" returned: 0 in 0.380s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:07 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e Nov 02 10:49:07 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:08 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-c6bfeac8-2191-4983-ab80-be061a0aea9e" returned: 0 in 0.246s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-quobyte-c6bfeac8-2191-4983-ab80-be061a0aea9e" released by "delete_volume" :: held 0.678s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:08 devstack cinder-volume[86926]: WARNING cinder.quota [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1782210272-1901604706 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1782210272-1901604706, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:08 devstack cinder-volume[86926]: WARNING cinder.quota [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1782210272-1901604706 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1782210272-1901604706, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Created reservations ['c8c28f38-60ca-4819-bd6a-5c882d17ee86', 'efb14e3f-768e-4b30-915b-40bdbbadec9d', '3bf43b25-8be7-4e48-b828-8d3da25f2bc3', '41ad00e8-3b3c-4ddf-8956-825cf669bfac'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:08 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:49:08 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:08 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Deleted volume successfully. Nov 02 10:49:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aebe92f6-adf3-4285-b62f-eff4cbccebfa tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-c6bfeac8-2191-4983-ab80-be061a0aea9e-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:10 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-1a8da97a-0b23-47f6-8def-3ded447c3cf3 req-1cd7c3ce-e0bb-42be-9be3-daf378c255b7 tempest-TestInstancesWithCinderVolumes-601508907 None] Terminate volume connection completed successfully. Nov 02 10:49:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-1a8da97a-0b23-47f6-8def-3ded447c3cf3 req-1cd7c3ce-e0bb-42be-9be3-daf378c255b7 tempest-TestInstancesWithCinderVolumes-601508907 None] Deleting attachment 304e34e4-6a7a-4fb5-9a36-9f5c683986be. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "cinder-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "cinder-quobyte-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-quobyte-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2548d-4838-4718-ac30-56ea5d4a5964]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:12 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c Nov 02 10:49:12 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:12 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" returned: 0 in 0.397s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:12 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c Nov 02 10:49:12 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:12 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" returned: 0 in 0.241s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-quobyte-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c" released by "delete_volume" :: held 0.679s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:12 devstack cinder-volume[86926]: WARNING cinder.quota [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921521322-696115256 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921521322-696115256, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:12 devstack cinder-volume[86926]: WARNING cinder.quota [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921521322-696115256 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921521322-696115256, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Created reservations ['5db9fbb2-1a4f-4232-b160-d0fb7cc059b5', '6dd43413-ebd3-4cbe-a823-a8a7d71dcb37', 'f4409539-2d1a-4e57-a332-55ee2869459e', '62ded76c-383a-413c-884a-de8682f98fb9'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:13 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:49:13 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:13 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.248s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Deleted volume successfully. Nov 02 10:49:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5676d393-d910-48b5-93de-9508ee835e08 tempest-TestInstancesWithCinderVolumes-601508907 None] Lock "cinder-a9bbcbf0-166e-45f3-90ee-5c2296ee7c3c-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-df3e25f8-10f1-4396-901a-3c2866c854dd req-e5cb8872-113e-4603-b952-548421ae1afa tempest-TestMinimumBasicScenario-671986504 None] Terminate volume connection completed successfully. Nov 02 10:49:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-df3e25f8-10f1-4396-901a-3c2866c854dd req-e5cb8872-113e-4603-b952-548421ae1afa tempest-TestMinimumBasicScenario-671986504 None] Deleting attachment edf7e89e-f13d-4212-8dc7-0cfd1456a772. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Acquiring lock "cinder-05db2b32-e2d9-4627-ad0d-813681a27ed7-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Lock "cinder-05db2b32-e2d9-4627-ad0d-813681a27ed7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Acquiring lock "cinder-quobyte-05db2b32-e2d9-4627-ad0d-813681a27ed7" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Lock "cinder-quobyte-05db2b32-e2d9-4627-ad0d-813681a27ed7" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc5db1f-aec3-45d3-855b-e46596c79850]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:18 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 Nov 02 10:49:18 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:18 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7" returned: 0 in 0.377s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:18 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7 Nov 02 10:49:18 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:19 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-05db2b32-e2d9-4627-ad0d-813681a27ed7" returned: 0 in 0.285s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Lock "cinder-quobyte-05db2b32-e2d9-4627-ad0d-813681a27ed7" released by "delete_volume" :: held 0.712s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Created reservations ['edadf0ae-bd50-4c01-ba48-f412f3d00e9a', '3cd9372d-809a-4b91-8149-7252a9decce8', '900b54fa-8f6b-4356-ae26-1cf7bf0df087', 'cd3be1b6-2dec-44e2-aa91-5acc6fe0a213'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:19 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:49:19 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:19 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:19 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Deleted volume successfully. Nov 02 10:49:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-34112459-644a-4973-99e2-c81831b19eac tempest-TestMinimumBasicScenario-671986504 None] Lock "cinder-05db2b32-e2d9-4627-ad0d-813681a27ed7-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:22 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:49:22 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:22 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.328s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:49:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:49:29 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=39,cinder:UPDATE=40,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:29 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=35,cinder:UPDATE=30,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:40 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:40 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Flow 'volume_create_manager' (c4c157b8-e353-482f-bb22-a0e2700b5117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73068880-66fe-427b-8b01-bd6cf169dd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73068880-66fe-427b-8b01-bd6cf169dd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-947600794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc328852-81bd-4325-abd1-4caa963c0e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5e3b6163b44574871d472c1a52751f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:47Z,use_quota=True,user_id='b3ba6d56519c4e1b84acf668f2f903f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c7c8a6-8297-4b2a-a4b7-7eb199ed2481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c7c8a6-8297-4b2a-a4b7-7eb199ed2481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffba9c9-18ed-4921-a5e7-d9a6d06cf02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffba9c9-18ed-4921-a5e7-d9a6d06cf02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc328852-81bd-4325-abd1-4caa963c0e4f', 'volume_name': 'volume-fc328852-81bd-4325-abd1-4caa963c0e4f', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35978a8-c682-4f32-814f-65a83029af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35978a8-c682-4f32-814f-65a83029af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06076727-9ad3-4b98-8bf6-75506718f375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Volume fc328852-81bd-4325-abd1-4caa963c0e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc328852-81bd-4325-abd1-4caa963c0e4f', 'volume_size': 1} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-947600794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc328852-81bd-4325-abd1-4caa963c0e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5e3b6163b44574871d472c1a52751f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:47Z,use_quota=True,user_id='b3ba6d56519c4e1b84acf668f2f903f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Creating volume fc328852-81bd-4325-abd1-4caa963c0e4f {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:47 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:47 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f 1073741824 Nov 02 10:49:47 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Flow 'volume_create_manager' (4694f1f5-3fe1-4e63-813b-32aa8478dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ba1043-f12d-492d-8842-f581f8c4d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ba1043-f12d-492d-8842-f581f8c4d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-325623221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b9d825-05bf-463e-a00d-e89d316b17c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5e3b6163b44574871d472c1a52751f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:48Z,use_quota=True,user_id='b3ba6d56519c4e1b84acf668f2f903f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6631a513-0a47-45b8-8b92-b85ed23515cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6631a513-0a47-45b8-8b92-b85ed23515cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dca3c7-e56e-4424-a96b-931c95ed8d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dca3c7-e56e-4424-a96b-931c95ed8d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b9d825-05bf-463e-a00d-e89d316b17c4', 'volume_name': 'volume-84b9d825-05bf-463e-a00d-e89d316b17c4', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae238106-3325-4b6d-a0a7-898679f46c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae238106-3325-4b6d-a0a7-898679f46c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2db1a4-2f78-45d0-b7c4-628caac0b01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Volume 84b9d825-05bf-463e-a00d-e89d316b17c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b9d825-05bf-463e-a00d-e89d316b17c4', 'volume_size': 1} Nov 02 10:49:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:48 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f 1073741824" returned: 0 in 0.606s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:48 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f Nov 02 10:49:48 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:48 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f" returned: 0 in 0.284s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-325623221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b9d825-05bf-463e-a00d-e89d316b17c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5e3b6163b44574871d472c1a52751f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:48Z,use_quota=True,user_id='b3ba6d56519c4e1b84acf668f2f903f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Creating volume 84b9d825-05bf-463e-a00d-e89d316b17c4 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06076727-9ad3-4b98-8bf6-75506718f375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc328852-81bd-4325-abd1-4caa963c0e4f', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:48 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 1073741824 Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bdeb11-0728-401e-8923-ef325f1b47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:48 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Volume volume-fc328852-81bd-4325-abd1-4caa963c0e4f (fc328852-81bd-4325-abd1-4caa963c0e4f): created successfully Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bdeb11-0728-401e-8923-ef325f1b47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Flow 'volume_create_manager' (c4c157b8-e353-482f-bb22-a0e2700b5117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-07be517e-71c6-4f9f-bcaa-262a864b0249 tempest-TestServerVolumeAttachmentScenario-105918569 None] Created volume successfully. Nov 02 10:49:49 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 1073741824" returned: 0 in 0.623s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:49 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 Nov 02 10:49:49 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:49 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4" returned: 0 in 0.367s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2db1a4-2f78-45d0-b7c4-628caac0b01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b9d825-05bf-463e-a00d-e89d316b17c4', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40fe317-21bc-4846-aee7-60927b8d8c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:49 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Volume volume-84b9d825-05bf-463e-a00d-e89d316b17c4 (84b9d825-05bf-463e-a00d-e89d316b17c4): created successfully Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40fe317-21bc-4846-aee7-60927b8d8c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Flow 'volume_create_manager' (4694f1f5-3fe1-4e63-813b-32aa8478dd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-493ae46b-cc77-4383-8c6d-4a51640bdae5 tempest-TestServerVolumeAttachmentScenario-105918569 None] Created volume successfully. Nov 02 10:49:59 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:59 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Flow 'volume_create_manager' (ee724d8f-5427-46d7-9241-0f78ef1b675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84f5276-93b9-40e4-b392-c9c367e6a0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84f5276-93b9-40e4-b392-c9c367e6a0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-219811101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15141ac045d5427cbf0198c1ae3d6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:04Z,use_quota=True,user_id='0126947ae5124f92976a0ca2e0e1b779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b197eb4-d98b-4cde-812a-96b040e08a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b197eb4-d98b-4cde-812a-96b040e08a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b291fa72-4a98-4d2d-b78c-1ef8ffedf41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b291fa72-4a98-4d2d-b78c-1ef8ffedf41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135', 'volume_name': 'volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a2db32-487d-46c9-a262-be0075ca32a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a2db32-487d-46c9-a262-be0075ca32a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066eb618-c8d5-4e67-9b6e-c82741cca711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Volume ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135', 'volume_size': 1} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-219811101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15141ac045d5427cbf0198c1ae3d6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:04Z,use_quota=True,user_id='0126947ae5124f92976a0ca2e0e1b779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Creating volume ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:04 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 1073741824 Nov 02 10:50:04 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:04 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 1073741824" returned: 0 in 0.438s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:04 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 Nov 02 10:50:04 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:04 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066eb618-c8d5-4e67-9b6e-c82741cca711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1d7fc2-42ce-4cde-9626-61f3c7bfc9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Volume volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 (ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135): created successfully Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1d7fc2-42ce-4cde-9626-61f3c7bfc9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Flow 'volume_create_manager' (ee724d8f-5427-46d7-9241-0f78ef1b675d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-34841ed8-559f-4bb8-b7bb-6d79a47bf4c4 tempest-TestImageHashVerification-596159944 None] Created volume successfully. Nov 02 10:50:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c920958-686f-40f0-9336-0cb0503e5f62]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:05 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 Nov 02 10:50:05 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:06 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" returned: 0 in 0.398s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:06 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fae8e2-496c-4bb1-8e49-2d3efea17f3a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:06 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 Nov 02 10:50:06 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:06 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" returned: 0 in 0.398s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 /opt/stack/data/cinder/conversion/ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135.temp_image.a39121ac-eed4-45e9-9e3c-4176c58ff94flm1xmd_x.img {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:06 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 /opt/stack/data/cinder/conversion/ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135.temp_image.a39121ac-eed4-45e9-9e3c-4176c58ff94flm1xmd_x.img Nov 02 10:50:06 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:12 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 /opt/stack/data/cinder/conversion/ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135.temp_image.a39121ac-eed4-45e9-9e3c-4176c58ff94flm1xmd_x.img" returned: 0 in 6.319s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a598476-18f2-4945-b175-96237f54d83f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:13 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 Nov 02 10:50:13 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:13 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" returned: 0 in 0.543s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:13 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/conversion/ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135.temp_image.a39121ac-eed4-45e9-9e3c-4176c58ff94flm1xmd_x.img {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:50:13 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Converted 1024.00 MB image at 162.02 MB/s Nov 02 10:50:13 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] a39121ac-eed4-45e9-9e3c-4176c58ff94f was raw, no need to convert to raw {{(pid=86926) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:50:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-6b41956e-8170-4501-b5b4-298b2d8b2efb req-23f47720-f685-4d9a-957d-6765d1f3548d tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:22 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:50:22 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:22 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:50:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:50:23 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:31 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.362s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Uploaded volume to glance image-id: a39121ac-eed4-45e9-9e3c-4176c58ff94f. {{(pid=86926) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:50:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-6b41956e-8170-4501-b5b4-298b2d8b2efb req-23f47720-f685-4d9a-957d-6765d1f3548d tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.153s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-6b41956e-8170-4501-b5b4-298b2d8b2efb req-23f47720-f685-4d9a-957d-6765d1f3548d tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b5760e96-9818-43c8-9acb-da4dffd43ada tempest-TestImageHashVerification-596159944 None] Copy volume to image completed successfully. Nov 02 10:50:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-6b41956e-8170-4501-b5b4-298b2d8b2efb req-23f47720-f685-4d9a-957d-6765d1f3548d tempest-TestServerVolumeAttachmentScenario-105918569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-fc328852-81bd-4325-abd1-4caa963c0e4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65226620-de2e-4d65-8c71-0fbba8645be1', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:50:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-6b41956e-8170-4501-b5b4-298b2d8b2efb req-23f47720-f685-4d9a-957d-6765d1f3548d tempest-TestServerVolumeAttachmentScenario-105918569 None] attachment_update completed successfully. Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Acquiring lock "cinder-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Lock "cinder-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Acquiring lock "cinder-quobyte-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Lock "cinder-quobyte-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d928468b-5d6b-4bd1-b257-9650301b8335]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 Nov 02 10:50:33 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:33 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" returned: 0 in 0.401s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135 Nov 02 10:50:33 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:34 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" returned: 0 in 0.261s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Lock "cinder-quobyte-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135" released by "delete_volume" :: held 0.704s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Created reservations ['0f7c6bf9-27ca-47f7-bd9f-e8ea96a03a64', '28514a71-d3f9-4fc2-a468-8933b10966a5', '65475f3e-01ec-4283-9ca9-dd1fd15d24e9', 'd693773f-12a9-4a98-aa60-e8bd52bc1cab'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:34 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:50:34 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:34 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.300s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Deleted volume successfully. Nov 02 10:50:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-98dbd3c2-096e-4e02-bd9e-59c9ab2ab0e6 tempest-TestImageHashVerification-596159944 None] Lock "cinder-ddd0d2a1-fcc5-4cee-ac70-b5c9d7bf0135-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-79dc5153-82f8-44ca-9ba6-c478d6fb14ed req-19d6bc57-6144-44ea-8b1f-d71262de3a38 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-79dc5153-82f8-44ca-9ba6-c478d6fb14ed req-19d6bc57-6144-44ea-8b1f-d71262de3a38 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-79dc5153-82f8-44ca-9ba6-c478d6fb14ed req-19d6bc57-6144-44ea-8b1f-d71262de3a38 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-79dc5153-82f8-44ca-9ba6-c478d6fb14ed req-19d6bc57-6144-44ea-8b1f-d71262de3a38 tempest-TestServerVolumeAttachmentScenario-105918569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-84b9d825-05bf-463e-a00d-e89d316b17c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01964664-a4df-4340-9268-04211305e8b9', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:50:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-79dc5153-82f8-44ca-9ba6-c478d6fb14ed req-19d6bc57-6144-44ea-8b1f-d71262de3a38 tempest-TestServerVolumeAttachmentScenario-105918569 None] attachment_update completed successfully. Nov 02 10:50:38 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-bcde8608-f31a-4c2d-a708-dc18431aebdc req-6aa3515d-4554-4e4a-a7f0-a06706e5c2f2 tempest-TestServerVolumeAttachmentScenario-105918569 None] Terminate volume connection completed successfully. Nov 02 10:50:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-bcde8608-f31a-4c2d-a708-dc18431aebdc req-6aa3515d-4554-4e4a-a7f0-a06706e5c2f2 tempest-TestServerVolumeAttachmentScenario-105918569 None] Deleting attachment 01964664-a4df-4340-9268-04211305e8b9. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:50:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-5f05b1be-047e-49f4-8643-2be11de8d25f req-72428b2f-8a39-4c40-9da6-17e7b30144f2 tempest-TestServerVolumeAttachmentScenario-105918569 None] Terminate volume connection completed successfully. Nov 02 10:50:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-5f05b1be-047e-49f4-8643-2be11de8d25f req-72428b2f-8a39-4c40-9da6-17e7b30144f2 tempest-TestServerVolumeAttachmentScenario-105918569 None] Deleting attachment 65226620-de2e-4d65-8c71-0fbba8645be1. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:50:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "cinder-84b9d825-05bf-463e-a00d-e89d316b17c4-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-84b9d825-05bf-463e-a00d-e89d316b17c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "cinder-quobyte-84b9d825-05bf-463e-a00d-e89d316b17c4" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-quobyte-84b9d825-05bf-463e-a00d-e89d316b17c4" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782748c-7cff-48af-b9c2-1888b3ea6051]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 Nov 02 10:50:45 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:45 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4" returned: 0 in 0.446s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4 Nov 02 10:50:45 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:45 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-84b9d825-05bf-463e-a00d-e89d316b17c4" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-quobyte-84b9d825-05bf-463e-a00d-e89d316b17c4" released by "delete_volume" :: held 0.785s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Created reservations ['50682aaa-7f7e-4004-9314-a1154c31c2ce', 'c640d1ab-2e2c-4e81-b0c9-26790726842b', 'fe13af83-7744-4605-8943-e254efdec975', 'e385aa4a-7dc1-4348-bfff-3f8a1e422448'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:50:45 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "cinder-fc328852-81bd-4325-abd1-4caa963c0e4f-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-fc328852-81bd-4325-abd1-4caa963c0e4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "cinder-quobyte-fc328852-81bd-4325-abd1-4caa963c0e4f" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-quobyte-fc328852-81bd-4325-abd1-4caa963c0e4f" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:46 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.337s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Deleted volume successfully. Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8401f-d8e9-40e3-8bf9-c4b27fb98a75]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0235e4fd-096a-47c6-80f7-b168fd7b1aa0 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-84b9d825-05bf-463e-a00d-e89d316b17c4-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:46 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f Nov 02 10:50:46 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f Nov 02 10:50:46 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fc328852-81bd-4325-abd1-4caa963c0e4f" returned: 0 in 0.278s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-quobyte-fc328852-81bd-4325-abd1-4caa963c0e4f" released by "delete_volume" :: held 0.739s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Created reservations ['3c9ecd94-6361-425e-87b9-d8f0deafac6b', 'c5ac1124-538a-4329-82e1-287f8ceff767', '7336008c-17aa-4c29-b4d6-b7cadd9f556d', 'b039d6e7-9c64-4f12-8d1c-968c6d7c3eb2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:47 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:50:47 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:47 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.293s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:47 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Deleted volume successfully. Nov 02 10:50:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3a4ea1f2-7477-47e6-8c65-fc59fdd49187 tempest-TestServerVolumeAttachmentScenario-105918569 None] Lock "cinder-fc328852-81bd-4325-abd1-4caa963c0e4f-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:56 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=32,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:57 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Flow 'volume_create_manager' (9ebd93e3-8707-4c6c-a52c-8903ca5ee023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a23df5c-e6fe-4052-9dce-e7fcd13dbfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a23df5c-e6fe-4052-9dce-e7fcd13dbfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2047525480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15078e9-b604-48c7-b81b-4f935f83ab3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa09e6d0533e4953b3c27f7632ac1b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:12Z,use_quota=True,user_id='d701007e2ba7477f8f3a64d5c3ba18a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe831fdb-370e-404b-9798-55b2dba71cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe831fdb-370e-404b-9798-55b2dba71cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1ca1ac-15b1-4467-b68c-3b032bc110cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1ca1ac-15b1-4467-b68c-3b032bc110cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e15078e9-b604-48c7-b81b-4f935f83ab3d', 'volume_name': 'volume-e15078e9-b604-48c7-b81b-4f935f83ab3d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f298e8-2fc6-4833-be79-86548ec3a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f298e8-2fc6-4833-be79-86548ec3a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c34cb38-e3d9-4fdd-b6de-44b76d59feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:11 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Volume e15078e9-b604-48c7-b81b-4f935f83ab3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e15078e9-b604-48c7-b81b-4f935f83ab3d', 'volume_size': 1} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2047525480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15078e9-b604-48c7-b81b-4f935f83ab3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa09e6d0533e4953b3c27f7632ac1b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:12Z,use_quota=True,user_id='d701007e2ba7477f8f3a64d5c3ba18a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Creating volume e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:11 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:51:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:11 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d 1073741824 Nov 02 10:51:11 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:12 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d 1073741824" returned: 0 in 0.518s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:12 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d Nov 02 10:51:12 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:12 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c34cb38-e3d9-4fdd-b6de-44b76d59feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15078e9-b604-48c7-b81b-4f935f83ab3d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6555d893-1898-4100-a9e6-3fb58fb66008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:12 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Volume volume-e15078e9-b604-48c7-b81b-4f935f83ab3d (e15078e9-b604-48c7-b81b-4f935f83ab3d): created successfully Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6555d893-1898-4100-a9e6-3fb58fb66008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:12 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Flow 'volume_create_manager' (9ebd93e3-8707-4c6c-a52c-8903ca5ee023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-97a960f0-59c8-4036-b624-def1da55ccbb tempest-TestStampPattern-695552539 None] Created volume successfully. Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:22 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:51:22 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:22 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:23 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.476s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:51:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:51:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Flow 'volume_create_manager' (831f06d8-9b22-4120-af93-c758530bab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23141ac3-39a7-4d98-8b20-2c6cd77c747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23141ac3-39a7-4d98-8b20-2c6cd77c747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-648666209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecd2224-7449-4b23-bef6-4bad0b4136bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d656f06376234374bb00c64e345c1acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:33Z,use_quota=True,user_id='2518b39e4ef3452aafd8e5c5a388e4a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005b1dc-ba51-4024-9320-8539f9c9bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005b1dc-ba51-4024-9320-8539f9c9bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7764585b-6a1e-464f-9714-c30517ddcb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7764585b-6a1e-464f-9714-c30517ddcb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aecd2224-7449-4b23-bef6-4bad0b4136bf', 'volume_name': 'volume-aecd2224-7449-4b23-bef6-4bad0b4136bf', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfed9501-06b5-42b8-a0d3-31127808f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfed9501-06b5-42b8-a0d3-31127808f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6433db8-17d4-4a9f-962d-230f52910042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:33 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Volume aecd2224-7449-4b23-bef6-4bad0b4136bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aecd2224-7449-4b23-bef6-4bad0b4136bf', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Trying to clone aecd2224-7449-4b23-bef6-4bad0b4136bf from image 6256c21e-7619-488e-bde7-257c3f79e20b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:51:33 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[26737f8a-b7bc-43ac-a9a1-faae221b04c4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:33 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD Nov 02 10:51:33 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:33 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b is fetched for user 2518b39e4ef3452aafd8e5c5a388e4a3. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0b8c4-270d-46d7-96e4-ab92c376dfb1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:33 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD Nov 02 10:51:33 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:34 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-648666209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecd2224-7449-4b23-bef6-4bad0b4136bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d656f06376234374bb00c64e345c1acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:33Z,use_quota=True,user_id='2518b39e4ef3452aafd8e5c5a388e4a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Creating volume aecd2224-7449-4b23-bef6-4bad0b4136bf {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:34 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:34 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf 1073741824 Nov 02 10:51:34 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:34 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf 1073741824" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:34 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf Nov 02 10:51:34 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:34 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf" returned: 0 in 0.240s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Attempting download of 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume aecd2224-7449-4b23-bef6-4bad0b4136bf. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80f0b86-2f93-49b8-9fb4-f2b0f2ad5da8]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:34 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl Nov 02 10:51:34 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:35 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:35 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl Nov 02 10:51:35 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:35 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl" returned: 1 in 0.313s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6256c21e-7619-488e-bde7-257c3f79e20b_rmbowbkl' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f89a6-5dee-4a6a-abea-63f139685f8c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:35 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD Nov 02 10:51:35 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:35 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] 6256c21e-7619-488e-bde7-257c3f79e20b was qcow2, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:51:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:35 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf Nov 02 10:51:35 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:37 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf" returned: 0 in 1.670s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6256c21e-7619-488e-bde7-257c3f79e20b_wnn88uhddevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:51:37 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Converted 112.00 MB image at 67.00 MB/s Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:37 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf 1G Nov 02 10:51:37 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:37 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf 1G" returned: 0 in 0.308s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Downloaded image 6256c21e-7619-488e-bde7-257c3f79e20b ((None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}])) to volume aecd2224-7449-4b23-bef6-4bad0b4136bf successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Temporary image 6256c21e-7619-488e-bde7-257c3f79e20b for user 2518b39e4ef3452aafd8e5c5a388e4a3 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Marking volume aecd2224-7449-4b23-bef6-4bad0b4136bf as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Copying metadata from image 6256c21e-7619-488e-bde7-257c3f79e20b to aecd2224-7449-4b23-bef6-4bad0b4136bf. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Creating volume glance metadata for volume aecd2224-7449-4b23-bef6-4bad0b4136bf backed by image 6256c21e-7619-488e-bde7-257c3f79e20b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6433db8-17d4-4a9f-962d-230f52910042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecd2224-7449-4b23-bef6-4bad0b4136bf', 'volume_size': 1, 'image_id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6256c21e-7619-488e-bde7-257c3f79e20b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f527d5d370d740eb927ba801ca6bc5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6256c21e-7619-488e-bde7-257c3f79e20b', 'created_at': datetime.datetime(2026, 11, 2, 9, 28, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 28, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6256c21e-7619-488e-bde7-257c3f79e20b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28632a7d-570e-427d-b363-e1845da8135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:37 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Volume volume-aecd2224-7449-4b23-bef6-4bad0b4136bf (aecd2224-7449-4b23-bef6-4bad0b4136bf): created successfully Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28632a7d-570e-427d-b363-e1845da8135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Flow 'volume_create_manager' (831f06d8-9b22-4120-af93-c758530bab81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-22ecae6f-8602-40dc-b57b-f6b00f0dea22 tempest-TestShelveInstance-809364025 None] Created volume successfully. Nov 02 10:51:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-6316b53c-eb7a-4ec7-b6df-12e2cfe5e0d2 req-7095b0f6-e2e6-4332-b890-3f8dbe6e166e tempest-TestShelveInstance-809364025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-6316b53c-eb7a-4ec7-b6df-12e2cfe5e0d2 req-7095b0f6-e2e6-4332-b890-3f8dbe6e166e tempest-TestShelveInstance-809364025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-6316b53c-eb7a-4ec7-b6df-12e2cfe5e0d2 req-7095b0f6-e2e6-4332-b890-3f8dbe6e166e tempest-TestShelveInstance-809364025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-6316b53c-eb7a-4ec7-b6df-12e2cfe5e0d2 req-7095b0f6-e2e6-4332-b890-3f8dbe6e166e tempest-TestShelveInstance-809364025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-aecd2224-7449-4b23-bef6-4bad0b4136bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e156c2d0-9248-457b-852f-8ee8b25d459f', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:51:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-6316b53c-eb7a-4ec7-b6df-12e2cfe5e0d2 req-7095b0f6-e2e6-4332-b890-3f8dbe6e166e tempest-TestShelveInstance-809364025 None] attachment_update completed successfully. Nov 02 10:51:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1e6b8ac0-3e3e-4124-85f4-68a241129b64 req-600c73cf-ba37-4fb0-9aae-c4aaabd4170a tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1e6b8ac0-3e3e-4124-85f4-68a241129b64 req-600c73cf-ba37-4fb0-9aae-c4aaabd4170a tempest-TestStampPattern-695552539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1e6b8ac0-3e3e-4124-85f4-68a241129b64 req-600c73cf-ba37-4fb0-9aae-c4aaabd4170a tempest-TestStampPattern-695552539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-1e6b8ac0-3e3e-4124-85f4-68a241129b64 req-600c73cf-ba37-4fb0-9aae-c4aaabd4170a tempest-TestStampPattern-695552539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-e15078e9-b604-48c7-b81b-4f935f83ab3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da0e4354-366b-4475-8ef3-65035b4322da', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:51:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-1e6b8ac0-3e3e-4124-85f4-68a241129b64 req-600c73cf-ba37-4fb0-9aae-c4aaabd4170a tempest-TestStampPattern-695552539 None] attachment_update completed successfully. Nov 02 10:51:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-85c9ee29-12ab-4b82-987a-b68a5e579f77 req-b615bee3-037d-417c-a5b9-afc994b3717f tempest-TestStampPattern-695552539 None] Terminate volume connection completed successfully. Nov 02 10:51:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-85c9ee29-12ab-4b82-987a-b68a5e579f77 req-b615bee3-037d-417c-a5b9-afc994b3717f tempest-TestStampPattern-695552539 None] Deleting attachment da0e4354-366b-4475-8ef3-65035b4322da. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Creating offline snapshot 3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb of volume e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4467266f-b1ee-42f8-91f2-c9e68ebe8b10]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:51 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d Nov 02 10:51:51 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:51 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d" returned: 0 in 0.395s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:51 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb 1G Nov 02 10:51:51 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:51 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb 1G" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15078e9-b604-48c7-b81b-4f935f83ab3d -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:52 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15078e9-b604-48c7-b81b-4f935f83ab3d -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb Nov 02 10:51:52 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:52 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15078e9-b604-48c7-b81b-4f935f83ab3d -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" returned: 0 in 0.283s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:52 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb is being set with open permissions: ugo+rw Nov 02 10:51:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:52 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb Nov 02 10:51:52 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:52 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" returned: 0 in 0.234s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:52 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info Nov 02 10:51:52 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:52 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:52 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info is being set with open permissions: ugo+rw Nov 02 10:51:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:52 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info Nov 02 10:51:52 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:53 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.info" returned: 0 in 0.237s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7019f888-ac8a-4136-85da-c441f7b54c6c tempest-TestStampPattern-695552539 None] Create snapshot completed successfully Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Flow 'volume_create_manager' (47c334e0-cce2-4279-bfb1-188e9470b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabfa1a4-0876-4483-b78d-29797aabda48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabfa1a4-0876-4483-b78d-29797aabda48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-248452935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959d8d55-d71c-4904-9ae9-9a0615232d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa09e6d0533e4953b3c27f7632ac1b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:00Z,use_quota=True,user_id='d701007e2ba7477f8f3a64d5c3ba18a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742b1db5-1793-46d9-9934-62c91f81c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742b1db5-1793-46d9-9934-62c91f81c262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b007863-11f0-43ec-85a1-f21e4ac52dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b007863-11f0-43ec-85a1-f21e4ac52dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '959d8d55-d71c-4904-9ae9-9a0615232d02', 'volume_name': 'volume-959d8d55-d71c-4904-9ae9-9a0615232d02', 'volume_size': 1, 'snapshot_id': '3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bdee41-f276-446b-a855-4d1a7df4d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bdee41-f276-446b-a855-4d1a7df4d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f6eacb-55f3-403b-9d50-b79fc6371b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:00 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Volume 959d8d55-d71c-4904-9ae9-9a0615232d02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-959d8d55-d71c-4904-9ae9-9a0615232d02', 'volume_size': 1, 'snapshot_id': '3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb'} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-quobyte-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb-959d8d55-d71c-4904-9ae9-9a0615232d02" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb-959d8d55-d71c-4904-9ae9-9a0615232d02" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Creating volume 959d8d55-d71c-4904-9ae9-9a0615232d02 from snapshot 3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-quobyte-959d8d55-d71c-4904-9ae9-9a0615232d02" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-959d8d55-d71c-4904-9ae9-9a0615232d02" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] snapshot: 3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb, volume: 959d8d55-d71c-4904-9ae9-9a0615232d02, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[146456cc-1e31-439e-a815-eb1ac6e56f51]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:00 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb Nov 02 10:52:00 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:00 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" returned: 0 in 0.489s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e15078e9-b604-48c7-b81b-4f935f83ab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a3115-87c3-43f7-80fe-80deebe9df30]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:01 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d Nov 02 10:52:01 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:01 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d" returned: 0 in 0.505s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:52:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:52:01 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:52:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:01 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 Nov 02 10:52:01 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=34,cinder:UPDATE=7,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:10 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02" returned: 0 in 8.878s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:52:10 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Converted 1024.00 MB image at 115.32 MB/s Nov 02 10:52:10 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 is being set with open permissions: ugo+rw Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:10 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 Nov 02 10:52:10 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=25,cinder:UPDATE=13,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:10 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02" returned: 0 in 0.277s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-959d8d55-d71c-4904-9ae9-9a0615232d02" released by "_copy_volume_from_snapshot" :: held 10.247s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb-959d8d55-d71c-4904-9ae9-9a0615232d02" released by "_create_volume_from_snapshot" :: held 10.352s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.373s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f6eacb-55f3-403b-9d50-b79fc6371b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959d8d55-d71c-4904-9ae9-9a0615232d02', 'volume_size': 1, 'snapshot_id': '3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38325e5e-e243-4297-9573-748698362a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:10 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Volume volume-959d8d55-d71c-4904-9ae9-9a0615232d02 (959d8d55-d71c-4904-9ae9-9a0615232d02): created successfully Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38325e5e-e243-4297-9573-748698362a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:10 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Flow 'volume_create_manager' (47c334e0-cce2-4279-bfb1-188e9470b245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:10 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9124d811-1cdc-433a-bdfc-7bc8d421131a tempest-TestStampPattern-695552539 None] Created volume successfully. Nov 02 10:52:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-5d49e1b4-83e8-4561-a94c-c0ed31e6aea5 req-0b23326e-2686-4bd0-957f-7c8742fe2fa2 tempest-TestShelveInstance-809364025 None] Terminate volume connection completed successfully. Nov 02 10:52:15 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-5d49e1b4-83e8-4561-a94c-c0ed31e6aea5 req-0b23326e-2686-4bd0-957f-7c8742fe2fa2 tempest-TestShelveInstance-809364025 None] Deleting attachment e156c2d0-9248-457b-852f-8ee8b25d459f. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:52:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c7c2f5bc-ab61-4f0e-b81f-843e087aa551 req-b1cc9062-b483-4463-8c1f-2572f5079922 tempest-TestShelveInstance-809364025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c7c2f5bc-ab61-4f0e-b81f-843e087aa551 req-b1cc9062-b483-4463-8c1f-2572f5079922 tempest-TestShelveInstance-809364025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-c7c2f5bc-ab61-4f0e-b81f-843e087aa551 req-b1cc9062-b483-4463-8c1f-2572f5079922 tempest-TestShelveInstance-809364025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:17 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-c7c2f5bc-ab61-4f0e-b81f-843e087aa551 req-b1cc9062-b483-4463-8c1f-2572f5079922 tempest-TestShelveInstance-809364025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-aecd2224-7449-4b23-bef6-4bad0b4136bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e99f2e70-64e7-414e-b33c-3a7d5308f0af', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:52:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-c7c2f5bc-ab61-4f0e-b81f-843e087aa551 req-b1cc9062-b483-4463-8c1f-2572f5079922 tempest-TestShelveInstance-809364025 None] attachment_update completed successfully. Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:22 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:52:22 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:22 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.316s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:52:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:52:27 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:27 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=8 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3e86787b-447b-4a4c-95a4-0a773de8c349 req-8726e38b-480f-490f-ac63-bfea8c2c9fad tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3e86787b-447b-4a4c-95a4-0a773de8c349 req-8726e38b-480f-490f-ac63-bfea8c2c9fad tempest-TestStampPattern-695552539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-3e86787b-447b-4a4c-95a4-0a773de8c349 req-8726e38b-480f-490f-ac63-bfea8c2c9fad tempest-TestStampPattern-695552539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-3e86787b-447b-4a4c-95a4-0a773de8c349 req-8726e38b-480f-490f-ac63-bfea8c2c9fad tempest-TestStampPattern-695552539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01', 'name': 'volume-959d8d55-d71c-4904-9ae9-9a0615232d02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ef7b8ca-34f7-46da-b4f7-391c74d07cff', 'enforce_multipath': True} {{(pid=86926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:52:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-3e86787b-447b-4a4c-95a4-0a773de8c349 req-8726e38b-480f-490f-ac63-bfea8c2c9fad tempest-TestStampPattern-695552539 None] attachment_update completed successfully. Nov 02 10:52:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-b97d4a9d-3843-4132-83d8-c8c5ca7d5ef6 req-20f1924a-b8e3-4149-b381-c293ccefc779 tempest-TestStampPattern-695552539 None] Terminate volume connection completed successfully. Nov 02 10:52:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-b97d4a9d-3843-4132-83d8-c8c5ca7d5ef6 req-20f1924a-b8e3-4149-b381-c293ccefc779 tempest-TestStampPattern-695552539 None] Deleting attachment 4ef7b8ca-34f7-46da-b4f7-391c74d07cff. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-959d8d55-d71c-4904-9ae9-9a0615232d02-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Lock "cinder-959d8d55-d71c-4904-9ae9-9a0615232d02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-quobyte-959d8d55-d71c-4904-9ae9-9a0615232d02" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-959d8d55-d71c-4904-9ae9-9a0615232d02" acquired by "delete_volume" :: waited 0.013s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcdef8-005d-4bf2-b585-ce98303dabcf]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:57 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 Nov 02 10:52:57 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:57 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02" returned: 0 in 0.387s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:57 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02 Nov 02 10:52:57 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:58 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-959d8d55-d71c-4904-9ae9-9a0615232d02" returned: 0 in 0.240s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-959d8d55-d71c-4904-9ae9-9a0615232d02" released by "delete_volume" :: held 0.668s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Created reservations ['ee0dad48-a9ef-4129-96f0-5e14c6dcfda4', '4037047e-2a93-4f57-9a87-547a8dad1a11', '0a1efe93-f98a-49d2-891a-711934e4d164', '2eb1a43d-3d76-4fb8-a96b-a25256efd762'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:58 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:52:58 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:58 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.243s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Deleted volume successfully. Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-476e3652-691a-41ed-b3a6-58f2d92349a3 tempest-TestStampPattern-695552539 None] Lock "cinder-959d8d55-d71c-4904-9ae9-9a0615232d02-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Lock "cinder-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-quobyte-e15078e9-b604-48c7-b81b-4f935f83ab3d" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-e15078e9-b604-48c7-b81b-4f935f83ab3d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-quobyte-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Deleting offline snapshot 3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb of volume e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] snapshot_file for this snap is: volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3096d9e7-f2f9-4080-9cac-c7ff00f469a9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:59 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb Nov 02 10:52:59 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:59 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" returned: 0 in 0.360s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e15078e9-b604-48c7-b81b-4f935f83ab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:59 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dec6f5-345f-4da8-bd69-50788292865c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:59 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d Nov 02 10:52:59 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:59 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d" returned: 0 in 0.537s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:59 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb Nov 02 10:52:59 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:00 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" returned: 0 in 0.415s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:00 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb Nov 02 10:53:00 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:00 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d.3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb" released by "_delete_snapshot" :: held 1.767s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-e15078e9-b604-48c7-b81b-4f935f83ab3d" released by "delete_snapshot" :: held 1.796s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Created reservations ['b8515f82-7f6b-4013-b39a-18f6c2c79ee3', '3e4585e8-9a4b-440c-8ce6-faac7bec1eae', '51fd7f48-0d02-44cb-9213-978657dc8488', 'e551c58d-201e-40fb-9b06-5a3bb1ba77b8'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Delete snapshot completed successfully. Nov 02 10:53:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7162524d-07bd-404d-af07-22cafdfde15b tempest-TestStampPattern-695552539 None] Lock "cinder-3f4d5e0a-2a9a-40be-96e0-07bb5269f8eb-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-be5290b6-088d-4098-b8b5-9f68f7db1017 tempest-TestShelveInstance-809364025 None] Terminate volume connection completed successfully. Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-be5290b6-088d-4098-b8b5-9f68f7db1017 tempest-TestShelveInstance-809364025 None] Deleting attachment e99f2e70-64e7-414e-b33c-3a7d5308f0af. {{(pid=86926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Acquiring lock "cinder-aecd2224-7449-4b23-bef6-4bad0b4136bf-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Lock "cinder-aecd2224-7449-4b23-bef6-4bad0b4136bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Acquiring lock "cinder-quobyte-aecd2224-7449-4b23-bef6-4bad0b4136bf" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Lock "cinder-quobyte-aecd2224-7449-4b23-bef6-4bad0b4136bf" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[444a5a73-c5fa-43e9-b374-3078c03a2eda]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:02 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf Nov 02 10:53:02 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:02 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf" returned: 0 in 0.499s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:02 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf Nov 02 10:53:02 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:03 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-aecd2224-7449-4b23-bef6-4bad0b4136bf" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Lock "cinder-quobyte-aecd2224-7449-4b23-bef6-4bad0b4136bf" released by "delete_volume" :: held 0.952s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG cinder.quota [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Created reservations ['d5e38063-c7e5-4055-827c-652c9f13e100', '14fd9ba1-e5c0-47c9-9b80-2b9255f33024', '4cb06bff-8d45-4be8-823f-e337b2139814', '8bfe287f-4561-473c-8951-565b9ae4d9e3'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:03 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:03 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:03 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.324s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:03 devstack cinder-volume[86926]: DEBUG cinder.manager [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Deleted volume successfully. Nov 02 10:53:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [req-1bd5eec5-2b3a-46e8-abca-95b45d1977bb req-7131413b-4d1b-4617-912d-0dfeb7174e2b tempest-TestShelveInstance-809364025 None] Lock "cinder-aecd2224-7449-4b23-bef6-4bad0b4136bf-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-e15078e9-b604-48c7-b81b-4f935f83ab3d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Lock "cinder-e15078e9-b604-48c7-b81b-4f935f83ab3d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Acquiring lock "cinder-quobyte-e15078e9-b604-48c7-b81b-4f935f83ab3d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-e15078e9-b604-48c7-b81b-4f935f83ab3d" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:05 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa7a0a-72be-4776-8053-797e24ea161d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:06 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d Nov 02 10:53:06 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:06 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d" returned: 0 in 0.369s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:06 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d Nov 02 10:53:06 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:06 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e15078e9-b604-48c7-b81b-4f935f83ab3d" returned: 0 in 0.261s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Lock "cinder-quobyte-e15078e9-b604-48c7-b81b-4f935f83ab3d" released by "delete_volume" :: held 0.700s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Created reservations ['58a95105-4641-4d8a-b1cd-a2546bbda624', '5605b929-fdca-4577-891a-8082ae30f307', 'e9e9dffd-1baa-40ba-b344-28eea96d1d0b', 'a30ada69-a934-4e40-9dee-515d16f8400c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:06 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:06 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:07 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.246s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:07 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Deleted volume successfully. Nov 02 10:53:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-337ec942-d7fe-4a9b-ae20-cc67cf3907f6 tempest-TestStampPattern-695552539 None] Lock "cinder-e15078e9-b604-48c7-b81b-4f935f83ab3d-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:16 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=27,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:53:17 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Flow 'volume_create_manager' (32d9a001-1bcf-48de-b845-d371e466f7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c334227-2904-4091-b43d-c3e983b010f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c334227-2904-4091-b43d-c3e983b010f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1220449018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b209996-296b-4062-9c67-4dc59de02d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4328b13b8334ae59c5e459a0b24ee3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:20Z,use_quota=True,user_id='71dfcb91c0f44804848bfe1cb129bef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3376d2-4d62-4d05-bc14-8fe76f01d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3376d2-4d62-4d05-bc14-8fe76f01d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23ad993-d8fb-414c-8c1f-36d09aa445f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23ad993-d8fb-414c-8c1f-36d09aa445f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b209996-296b-4062-9c67-4dc59de02d83', 'volume_name': 'volume-0b209996-296b-4062-9c67-4dc59de02d83', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ba42fd-8030-442d-bccb-5c582e87bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ba42fd-8030-442d-bccb-5c582e87bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe4746f-dfcb-4480-828c-4932886dc172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:19 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Volume 0b209996-296b-4062-9c67-4dc59de02d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b209996-296b-4062-9c67-4dc59de02d83', 'volume_size': 1} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1220449018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b209996-296b-4062-9c67-4dc59de02d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4328b13b8334ae59c5e459a0b24ee3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:20Z,use_quota=True,user_id='71dfcb91c0f44804848bfe1cb129bef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Creating volume 0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:19 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:53:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:19 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 1073741824 Nov 02 10:53:19 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Flow 'volume_create_manager' (9c21658f-601e-41f8-a04c-cef87bd05ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fa3043-1d68-4e7e-bda4-598e7341d92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fa3043-1d68-4e7e-bda4-598e7341d92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd97ad7-2217-4251-9a34-3d4d4607622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a12ed6379a4aabaa3186dc1283132f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:20Z,use_quota=True,user_id='02ecb8bd867d478b9aedf190d3ce3ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e8c563-a3e6-4394-817a-86978d227649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e8c563-a3e6-4394-817a-86978d227649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c77f6e-1201-42aa-85f4-b25027edf4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:53:20 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 1073741824" returned: 0 in 0.438s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 Nov 02 10:53:20 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c77f6e-1201-42aa-85f4-b25027edf4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1fd97ad7-2217-4251-9a34-3d4d4607622d', 'volume_name': 'volume-1fd97ad7-2217-4251-9a34-3d4d4607622d', 'volume_size': 1, 'image_id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0061a192-f29c-466e-ad9d-8c7af9c81168', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04bb174a7fe321394d4b40ea003c23ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08a12ed6379a4aabaa3186dc1283132f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5d865e6a81097c85ab13851613be4e734815d95d61390923fb0ae1e6cf082a7115a6101b147e36c6daf8601322d762e5f1d104431472174d335f234ff414fee', 'id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'created_at': datetime.datetime(2026, 11, 2, 9, 53, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0061a192-f29c-466e-ad9d-8c7af9c81168/file', 'properties': {}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9149ff-5ef6-4a62-9b7d-1d4c7dc1139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9149ff-5ef6-4a62-9b7d-1d4c7dc1139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57796e44-0b38-4311-b35d-e459210549c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Volume 1fd97ad7-2217-4251-9a34-3d4d4607622d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1fd97ad7-2217-4251-9a34-3d4d4607622d', 'volume_size': 1, 'image_id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0061a192-f29c-466e-ad9d-8c7af9c81168', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04bb174a7fe321394d4b40ea003c23ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08a12ed6379a4aabaa3186dc1283132f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5d865e6a81097c85ab13851613be4e734815d95d61390923fb0ae1e6cf082a7115a6101b147e36c6daf8601322d762e5f1d104431472174d335f234ff414fee', 'id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'created_at': datetime.datetime(2026, 11, 2, 9, 53, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0061a192-f29c-466e-ad9d-8c7af9c81168/file', 'properties': {}}, 'image_service': } Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Trying to clone 1fd97ad7-2217-4251-9a34-3d4d4607622d from image 0061a192-f29c-466e-ad9d-8c7af9c81168 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0061a192-f29c-466e-ad9d-8c7af9c81168', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:53:20 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83" returned: 0 in 0.248s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe4746f-dfcb-4480-828c-4932886dc172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b209996-296b-4062-9c67-4dc59de02d83', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73bd5ef2-1e51-44a5-8c34-9762ba4482ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Volume volume-0b209996-296b-4062-9c67-4dc59de02d83 (0b209996-296b-4062-9c67-4dc59de02d83): created successfully Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73bd5ef2-1e51-44a5-8c34-9762ba4482ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Flow 'volume_create_manager' (32d9a001-1bcf-48de-b845-d371e466f7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:53:20 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:53:20 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-530bfc12-7da8-4296-a0a2-c0626b8b377d tempest-VolumeDependencyTests-1884134950 None] Created volume successfully. Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7e45e-520c-4b0c-ae7c-661c81b61c6d]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD Nov 02 10:53:20 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Creating offline snapshot 7da1afbd-1205-4850-8004-3104a6406f08 of volume 0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55337e-5a23-41e7-abfe-52d7c56b6a11]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 Nov 02 10:53:21 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD Nov 02 10:53:21 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Temporary image 0061a192-f29c-466e-ad9d-8c7af9c81168 is fetched for user 02ecb8bd867d478b9aedf190d3ce3ca6. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:53:21 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 1G Nov 02 10:53:21 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e88ed8-6392-4d51-9e6e-659455a1fa5d]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD Nov 02 10:53:21 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 1G" returned: 0 in 0.429s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b209996-296b-4062-9c67-4dc59de02d83 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b209996-296b-4062-9c67-4dc59de02d83 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 Nov 02 10:53:21 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD Nov 02 10:53:21 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b209996-296b-4062-9c67-4dc59de02d83 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08" returned: 0 in 0.334s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 is being set with open permissions: ugo+rw Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 Nov 02 10:53:22 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08" returned: 0 in 0.257s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info Nov 02 10:53:22 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info" returned: 0 in 0.249s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info is being set with open permissions: ugo+rw Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info Nov 02 10:53:22 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:22 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.info" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd97ad7-2217-4251-9a34-3d4d4607622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a12ed6379a4aabaa3186dc1283132f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:20Z,use_quota=True,user_id='02ecb8bd867d478b9aedf190d3ce3ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Creating volume 1fd97ad7-2217-4251-9a34-3d4d4607622d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:22 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:22 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d 1073741824 Nov 02 10:53:22 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:53:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:53:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-59bc5ed9-233a-41a0-bccf-d6919f44b1bb tempest-VolumeDependencyTests-1884134950 None] Create snapshot completed successfully Nov 02 10:53:23 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d 1073741824" returned: 0 in 0.415s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:23 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d Nov 02 10:53:23 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:23 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d" returned: 0 in 0.238s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Attempting download of 0061a192-f29c-466e-ad9d-8c7af9c81168 ((None, [{'url': 'file:///opt/stack/data/glance/images/0061a192-f29c-466e-ad9d-8c7af9c81168', 'metadata': {}}])) to volume 1fd97ad7-2217-4251-9a34-3d4d4607622d. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00dd794-4c3d-4802-b00c-f196c7d37d1f]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:23 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8 Nov 02 10:53:23 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:23 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8 Nov 02 10:53:24 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8" returned: 1 in 0.336s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0061a192-f29c-466e-ad9d-8c7af9c81168_lqvf5bc8' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dca83c-f296-4eae-b646-fb737907ccf7]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD Nov 02 10:53:24 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Flow 'volume_create_manager' (39debf64-c03d-4b86-b005-d0c0b68c515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f68eb19-4f1d-45e9-b564-dab569b19fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f68eb19-4f1d-45e9-b564-dab569b19fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-237797223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6c3c3d-064c-44cb-a149-04cd8ed51bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4328b13b8334ae59c5e459a0b24ee3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7da1afbd-1205-4850-8004-3104a6406f08,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:25Z,use_quota=True,user_id='71dfcb91c0f44804848bfe1cb129bef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a6af7-3fd4-466c-b384-d15f3e8cb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a6af7-3fd4-466c-b384-d15f3e8cb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57e3f73-0ddf-49c4-98cb-c2428c48fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57e3f73-0ddf-49c4-98cb-c2428c48fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c6c3c3d-064c-44cb-a149-04cd8ed51bbd', 'volume_name': 'volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd', 'volume_size': 1, 'snapshot_id': '7da1afbd-1205-4850-8004-3104a6406f08'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb150696-6296-49e0-8704-7be96bdba9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb150696-6296-49e0-8704-7be96bdba9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ea2012-016c-4978-a6cf-2df135c18b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Volume 3c6c3c3d-064c-44cb-a149-04cd8ed51bbd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd', 'volume_size': 1, 'snapshot_id': '7da1afbd-1205-4850-8004-3104a6406f08'} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-quobyte-7da1afbd-1205-4850-8004-3104a6406f08-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-7da1afbd-1205-4850-8004-3104a6406f08-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Creating volume 3c6c3c3d-064c-44cb-a149-04cd8ed51bbd from snapshot 7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:24 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-quobyte-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] snapshot: 7da1afbd-1205-4850-8004-3104a6406f08, volume: 3c6c3c3d-064c-44cb-a149-04cd8ed51bbd, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd99975c-2ffe-4955-872b-765d81a92746]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD Nov 02 10:53:24 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 Nov 02 10:53:24 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] 0061a192-f29c-466e-ad9d-8c7af9c81168 was raw, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d Nov 02 10:53:25 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08" returned: 0 in 0.374s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b209996-296b-4062-9c67-4dc59de02d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4814da-2f9e-440b-8678-e1482c799d96]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 Nov 02 10:53:25 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d" returned: 0 in 0.514s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0061a192-f29c-466e-ad9d-8c7af9c81168_k969vuurdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:53:25 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd Nov 02 10:53:25 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d 1G Nov 02 10:53:25 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d 1G" returned: 0 in 0.332s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Downloaded image 0061a192-f29c-466e-ad9d-8c7af9c81168 ((None, [{'url': 'file:///opt/stack/data/glance/images/0061a192-f29c-466e-ad9d-8c7af9c81168', 'metadata': {}}])) to volume 1fd97ad7-2217-4251-9a34-3d4d4607622d successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Temporary image 0061a192-f29c-466e-ad9d-8c7af9c81168 for user 02ecb8bd867d478b9aedf190d3ce3ca6 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Marking volume 1fd97ad7-2217-4251-9a34-3d4d4607622d as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Copying metadata from image 0061a192-f29c-466e-ad9d-8c7af9c81168 to 1fd97ad7-2217-4251-9a34-3d4d4607622d. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:53:25 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Creating volume glance metadata for volume 1fd97ad7-2217-4251-9a34-3d4d4607622d backed by image 0061a192-f29c-466e-ad9d-8c7af9c81168 with: {'image_id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '04bb174a7fe321394d4b40ea003c23ec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57796e44-0b38-4311-b35d-e459210549c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd97ad7-2217-4251-9a34-3d4d4607622d', 'volume_size': 1, 'image_id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0061a192-f29c-466e-ad9d-8c7af9c81168', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04bb174a7fe321394d4b40ea003c23ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08a12ed6379a4aabaa3186dc1283132f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5d865e6a81097c85ab13851613be4e734815d95d61390923fb0ae1e6cf082a7115a6101b147e36c6daf8601322d762e5f1d104431472174d335f234ff414fee', 'id': '0061a192-f29c-466e-ad9d-8c7af9c81168', 'created_at': datetime.datetime(2026, 11, 2, 9, 53, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0061a192-f29c-466e-ad9d-8c7af9c81168/file', 'properties': {}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917119a8-ad1e-49ac-98df-fde48a2dc25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Volume volume-1fd97ad7-2217-4251-9a34-3d4d4607622d (1fd97ad7-2217-4251-9a34-3d4d4607622d): created successfully Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917119a8-ad1e-49ac-98df-fde48a2dc25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Flow 'volume_create_manager' (9c21658f-601e-41f8-a04c-cef87bd05ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-799a3b7a-2fa9-42e3-a26a-8c7caa31ec59 tempest-VolumeImageDependencyTests-85935928 None] Created volume successfully. Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Acquiring lock "cinder-1fd97ad7-2217-4251-9a34-3d4d4607622d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Lock "cinder-1fd97ad7-2217-4251-9a34-3d4d4607622d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Acquiring lock "cinder-quobyte-1fd97ad7-2217-4251-9a34-3d4d4607622d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Lock "cinder-quobyte-1fd97ad7-2217-4251-9a34-3d4d4607622d" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e47fb-b926-4a0f-9d35-66de5a693d97]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d Nov 02 10:53:26 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:27 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d" returned: 0 in 0.736s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:27 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d Nov 02 10:53:27 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:27 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1fd97ad7-2217-4251-9a34-3d4d4607622d" returned: 0 in 0.341s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Lock "cinder-quobyte-1fd97ad7-2217-4251-9a34-3d4d4607622d" released by "delete_volume" :: held 1.158s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Created reservations ['93286f2c-c85a-4341-973b-413015165d32', 'efd6f455-946d-41b1-9800-16e32c55ed93', 'd68206e8-bf13-4c80-b614-e7e703f08b05', '4af1525b-9f80-4235-9743-2c087e4eb5be'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:28 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:28 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:28 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.392s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Deleted volume successfully. Nov 02 10:53:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f6a2eec1-c0a5-4980-a423-aeb76c37d4a5 tempest-VolumeImageDependencyTests-85935928 None] Lock "cinder-1fd97ad7-2217-4251-9a34-3d4d4607622d-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:32 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" returned: 0 in 6.682s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:53:32 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Converted 1024.00 MB image at 153.22 MB/s Nov 02 10:53:32 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd is being set with open permissions: ugo+rw Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd Nov 02 10:53:32 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:32 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" returned: 0 in 0.238s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" released by "_copy_volume_from_snapshot" :: held 7.768s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-7da1afbd-1205-4850-8004-3104a6406f08-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" released by "_create_volume_from_snapshot" :: held 7.846s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.862s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ea2012-016c-4978-a6cf-2df135c18b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd', 'volume_size': 1, 'snapshot_id': '7da1afbd-1205-4850-8004-3104a6406f08'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0b6561-9407-43da-8551-4b6566403be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:32 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Volume volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd (3c6c3c3d-064c-44cb-a149-04cd8ed51bbd): created successfully Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0b6561-9407-43da-8551-4b6566403be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:32 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Flow 'volume_create_manager' (39debf64-c03d-4b86-b005-d0c0b68c515a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:32 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2fe9a219-6ba9-42ca-a397-4ac163abefd4 tempest-VolumeDependencyTests-1884134950 None] Created volume successfully. Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-7da1afbd-1205-4850-8004-3104a6406f08-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-7da1afbd-1205-4850-8004-3104a6406f08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-quobyte-0b209996-296b-4062-9c67-4dc59de02d83" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-0b209996-296b-4062-9c67-4dc59de02d83" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-quobyte-7da1afbd-1205-4850-8004-3104a6406f08" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-7da1afbd-1205-4850-8004-3104a6406f08" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Deleting offline snapshot 7da1afbd-1205-4850-8004-3104a6406f08 of volume 0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] snapshot_file for this snap is: volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d302012a-af2e-4a14-8fb8-df8294832921]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 Nov 02 10:53:33 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:33 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08" returned: 0 in 0.395s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b209996-296b-4062-9c67-4dc59de02d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f43815-7715-4896-9927-ed6ee3b5c5a5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 Nov 02 10:53:33 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83" returned: 0 in 0.578s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 Nov 02 10:53:34 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08" returned: 0 in 0.351s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08 Nov 02 10:53:34 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:35 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83.7da1afbd-1205-4850-8004-3104a6406f08" returned: 0 in 0.254s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-7da1afbd-1205-4850-8004-3104a6406f08" released by "_delete_snapshot" :: held 1.693s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-0b209996-296b-4062-9c67-4dc59de02d83" released by "delete_snapshot" :: held 1.720s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Created reservations ['250ae697-82fa-4729-9c92-3910bb8369e5', '0ae5be03-58c1-4814-be81-46cdbb3d037b', 'd1c14626-389f-4772-8aab-926b824caf6b', '5127a6e0-9b49-407a-83db-962565d94f7d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Delete snapshot completed successfully. Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-342c468d-5f55-4516-bfd9-8466442381b8 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-7da1afbd-1205-4850-8004-3104a6406f08-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-0b209996-296b-4062-9c67-4dc59de02d83-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-0b209996-296b-4062-9c67-4dc59de02d83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-quobyte-0b209996-296b-4062-9c67-4dc59de02d83" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-0b209996-296b-4062-9c67-4dc59de02d83" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbe86a-73d9-4ab5-abca-1d552a154367]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:35 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 Nov 02 10:53:35 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:35 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83" returned: 0 in 0.410s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:36 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83 Nov 02 10:53:36 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:36 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0b209996-296b-4062-9c67-4dc59de02d83" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-0b209996-296b-4062-9c67-4dc59de02d83" released by "delete_volume" :: held 0.743s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Created reservations ['7de53d02-7194-4950-9efd-4c6131f63ff7', '2ca7e8fe-f3a9-4994-870f-57bc31aa174e', 'e8439ab2-01bb-4e13-a950-5dc3fb3427c1', 'fa3a1f2d-797e-40a3-a4f3-c0addc4f4062'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:36 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:36 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:36 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.315s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Deleted volume successfully. Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-65ebc29b-52b5-4455-9a80-8279800c5ee1 tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-0b209996-296b-4062-9c67-4dc59de02d83-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "cinder-quobyte-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ba3bc7-f310-4844-a0ee-e3502015ccd3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:36 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd Nov 02 10:53:36 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:37 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" returned: 0 in 0.401s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:37 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd Nov 02 10:53:37 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:37 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-quobyte-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd" released by "delete_volume" :: held 0.724s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Created reservations ['4ffaca38-b51e-46bb-8b0e-c6a50b88ccd7', 'f5834973-990b-41a6-9827-06d1355890ad', 'dd4838d0-1ac5-49b5-82f3-19fc1094878c', '7c21bc3e-cd9c-476e-bb9f-696fc1380e73'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:37 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:37 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:37 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.257s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Deleted volume successfully. Nov 02 10:53:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0c41dcac-e315-4763-a5a5-dfd7a621c8fe tempest-VolumeDependencyTests-1884134950 None] Lock "cinder-3c6c3c3d-064c-44cb-a149-04cd8ed51bbd-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Flow 'volume_create_manager' (2a121947-6bb5-4f4b-93f7-09df3b45e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7e6742-fe8a-414a-b7ae-179d2f26caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7e6742-fe8a-414a-b7ae-179d2f26caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d989c40-1de4-44e3-a5e4-3993ae32bf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a70cbc159949d7bef926d088d0bc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:41Z,use_quota=True,user_id='7d91a2cbe43844aa8bc533f2a4c8b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683fd8bc-1e24-4df0-9793-36ba7a2b2c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683fd8bc-1e24-4df0-9793-36ba7a2b2c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecec4d9e-4fc0-4dad-9719-e1c01f535d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecec4d9e-4fc0-4dad-9719-e1c01f535d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d989c40-1de4-44e3-a5e4-3993ae32bf71', 'volume_name': 'volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9b4e8e-cf59-4c44-8c3b-c3e53ebcf8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9b4e8e-cf59-4c44-8c3b-c3e53ebcf8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb3afc4-d6db-4ce7-a4d2-43c5d09c4fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Volume 7d989c40-1de4-44e3-a5e4-3993ae32bf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71', 'volume_size': 1} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d989c40-1de4-44e3-a5e4-3993ae32bf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a70cbc159949d7bef926d088d0bc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:41Z,use_quota=True,user_id='7d91a2cbe43844aa8bc533f2a4c8b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Creating volume 7d989c40-1de4-44e3-a5e4-3993ae32bf71 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:41 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 1073741824 Nov 02 10:53:41 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 1073741824" returned: 0 in 0.490s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 Nov 02 10:53:41 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:42 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71" returned: 0 in 0.246s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb3afc4-d6db-4ce7-a4d2-43c5d09c4fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e57340-34b2-4837-9e02-ad2142b3cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:42 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Volume volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 (7d989c40-1de4-44e3-a5e4-3993ae32bf71): created successfully Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e57340-34b2-4837-9e02-ad2142b3cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Flow 'volume_create_manager' (2a121947-6bb5-4f4b-93f7-09df3b45e966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e2b19e49-6580-4849-91d1-21c5a41749dc tempest-CinderUnicodeTest-198968450 None] Created volume successfully. Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Flow 'volume_create_manager' (64f573d6-02f9-402b-90b9-1eb508a8ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0342d83c-abea-4375-a1c1-a1f859492e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0342d83c-abea-4375-a1c1-a1f859492e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1762907400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a70cbc159949d7bef926d088d0bc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:44Z,use_quota=True,user_id='7d91a2cbe43844aa8bc533f2a4c8b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad65c5f-725f-4d2a-b7d7-51e62f8e86be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad65c5f-725f-4d2a-b7d7-51e62f8e86be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e97ae29-b2a8-43e0-80d1-d3c7162554c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e97ae29-b2a8-43e0-80d1-d3c7162554c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa', 'volume_name': 'volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6b78ca-31b1-497b-a14e-0502e0a208a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6b78ca-31b1-497b-a14e-0502e0a208a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8aeeda-a28e-41d2-bde5-bbf4a5503a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Volume 50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa', 'volume_size': 1} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1762907400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a70cbc159949d7bef926d088d0bc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:44Z,use_quota=True,user_id='7d91a2cbe43844aa8bc533f2a4c8b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Creating volume 50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:44 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa 1073741824 Nov 02 10:53:44 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa 1073741824" returned: 0 in 0.495s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa Nov 02 10:53:44 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" returned: 0 in 0.262s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8aeeda-a28e-41d2-bde5-bbf4a5503a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60db278d-05f1-49e3-82e5-1c5cbf281397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Volume volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa (50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa): created successfully Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60db278d-05f1-49e3-82e5-1c5cbf281397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Flow 'volume_create_manager' (64f573d6-02f9-402b-90b9-1eb508a8ff90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e92f162f-f900-4685-b283-ba1ffa641b0d tempest-CinderUnicodeTest-198968450 None] Created volume successfully. Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Creating offline snapshot e0234d89-0ce7-4085-8ade-5ea6511c13e7 of volume 50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e69458-e4ab-48e3-b7bb-4fd25be39220]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:46 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa Nov 02 10:53:46 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:46 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" returned: 0 in 0.360s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:46 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 1G Nov 02 10:53:46 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:46 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 1G" returned: 0 in 0.399s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:47 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 Nov 02 10:53:47 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:47 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7" returned: 0 in 0.389s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:47 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 is being set with open permissions: ugo+rw Nov 02 10:53:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:47 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 Nov 02 10:53:47 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:47 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:47 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info Nov 02 10:53:47 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:47 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info" returned: 0 in 0.250s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:47 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info is being set with open permissions: ugo+rw Nov 02 10:53:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:47 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info Nov 02 10:53:47 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:48 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.info" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-abf9abff-a36b-4199-b386-c5daf0fc3acb tempest-CinderUnicodeTest-198968450 None] Create snapshot completed successfully Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-e0234d89-0ce7-4085-8ade-5ea6511c13e7-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-e0234d89-0ce7-4085-8ade-5ea6511c13e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-quobyte-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-quobyte-e0234d89-0ce7-4085-8ade-5ea6511c13e7" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-e0234d89-0ce7-4085-8ade-5ea6511c13e7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Deleting offline snapshot e0234d89-0ce7-4085-8ade-5ea6511c13e7 of volume 50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] snapshot_file for this snap is: volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5de310-a3c2-4d28-9341-d2288ab61661]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:49 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 Nov 02 10:53:49 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:49 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7" returned: 0 in 0.417s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da5aac-5cb9-4440-9b4d-4a59cc39c66c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:50 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa Nov 02 10:53:50 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:50 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" returned: 0 in 0.377s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:50 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 Nov 02 10:53:50 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:50 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:50 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7 Nov 02 10:53:50 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:50 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa.e0234d89-0ce7-4085-8ade-5ea6511c13e7" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-e0234d89-0ce7-4085-8ade-5ea6511c13e7" released by "_delete_snapshot" :: held 1.571s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" released by "delete_snapshot" :: held 1.596s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Created reservations ['cba85643-24f3-4eaf-bb65-9a414ab80d8d', '0b4bb0a6-f5d0-4e6e-ab05-6124127ffc8f', '42aae4b0-cba9-4930-b275-5c8a5c5824e8', '38135340-ad1c-4565-8100-5e9c54e13d81'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Delete snapshot completed successfully. Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c7207f52-b51c-43de-9cdc-fb078fb738c9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-e0234d89-0ce7-4085-8ade-5ea6511c13e7-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-quobyte-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16e221-665c-42ac-83f3-36e893710377]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:51 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa Nov 02 10:53:51 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:52 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" returned: 0 in 0.387s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:52 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa Nov 02 10:53:52 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:52 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa" released by "delete_volume" :: held 0.709s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Created reservations ['64d7ece9-8e54-4867-b653-43543c4eb472', 'a794cad0-42aa-416d-a37f-1b426042b72e', '27b8f37e-1072-45d4-ac62-ef857873669a', '6e84696f-acfc-479a-be69-18a46d928128'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:52 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:52 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-7d989c40-1de4-44e3-a5e4-3993ae32bf71-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-7d989c40-1de4-44e3-a5e4-3993ae32bf71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "cinder-quobyte-7d989c40-1de4-44e3-a5e4-3993ae32bf71" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-7d989c40-1de4-44e3-a5e4-3993ae32bf71" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0de085-6a80-4e76-af82-53ae4e40d4f0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:52 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.424s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Deleted volume successfully. Nov 02 10:53:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e6075eaa-07f4-4065-96a6-2afb01b54ae9 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-50ffd09a-96f7-4ea4-aca5-9c98aa4cbfaa-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:53 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 Nov 02 10:53:53 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:53 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71" returned: 0 in 0.420s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:53 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71 Nov 02 10:53:53 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:53 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7d989c40-1de4-44e3-a5e4-3993ae32bf71" returned: 0 in 0.249s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-quobyte-7d989c40-1de4-44e3-a5e4-3993ae32bf71" released by "delete_volume" :: held 0.729s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Created reservations ['b57b912e-bcf9-454a-9f87-5db613842cb7', '8ee19922-c524-43f4-893d-c8b53e205cdc', '78a26e69-8b6b-40bb-920b-e0db17c8056d', 'e9b7bf56-a422-47cd-860e-b5026ccaf811'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:53 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:53:53 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:54 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.278s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:54 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Deleted volume successfully. Nov 02 10:53:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0029dcf0-831d-4735-a27b-347f8ad8e546 tempest-CinderUnicodeTest-198968450 None] Lock "cinder-7d989c40-1de4-44e3-a5e4-3993ae32bf71-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Flow 'volume_create_manager' (4f44ad7c-054f-4c25-846b-93540ba6551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568331c4-dc8d-4d5e-b516-c97ce9f82ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568331c4-dc8d-4d5e-b516-c97ce9f82ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1395167186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573556da-7464-4987-b612-1ecbc24cc9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7563cbf5fad4a828598e9a4defa6f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:03Z,use_quota=True,user_id='b258a1a8c4444407854686eacc176816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc7ce5b-827b-4828-a233-bdb9e848eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc7ce5b-827b-4828-a233-bdb9e848eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b26b8-3935-415c-8956-9005d5927f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b26b8-3935-415c-8956-9005d5927f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573556da-7464-4987-b612-1ecbc24cc9ae', 'volume_name': 'volume-573556da-7464-4987-b612-1ecbc24cc9ae', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93ed49d-23db-4a0f-b735-dcdf0dc0ed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93ed49d-23db-4a0f-b735-dcdf0dc0ed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61665d14-7991-4f8e-8e8c-8d0d826a642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Volume 573556da-7464-4987-b612-1ecbc24cc9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573556da-7464-4987-b612-1ecbc24cc9ae', 'volume_size': 1} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1395167186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573556da-7464-4987-b612-1ecbc24cc9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7563cbf5fad4a828598e9a4defa6f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:03Z,use_quota=True,user_id='b258a1a8c4444407854686eacc176816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Creating volume 573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:03 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae 1073741824 Nov 02 10:54:03 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae 1073741824" returned: 0 in 0.394s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae Nov 02 10:54:03 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae" returned: 0 in 0.228s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61665d14-7991-4f8e-8e8c-8d0d826a642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573556da-7464-4987-b612-1ecbc24cc9ae', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3213128a-efa5-44a2-b727-f4de2b8f0eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Volume volume-573556da-7464-4987-b612-1ecbc24cc9ae (573556da-7464-4987-b612-1ecbc24cc9ae): created successfully Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3213128a-efa5-44a2-b727-f4de2b8f0eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Flow 'volume_create_manager' (4f44ad7c-054f-4c25-846b-93540ba6551c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c9d447cd-de64-4421-9ce5-c0f0e2d4a003 tempest-SnapshotDependencyTests-1499260446 None] Created volume successfully. Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Creating offline snapshot 0e6a03d8-7ced-48a1-bc4d-161642fac72a of volume 573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb150b-34c7-4e09-bcef-003abc73d27e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:04 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae Nov 02 10:54:04 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:04 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:04 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a 1G Nov 02 10:54:04 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:04 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a 1G" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-573556da-7464-4987-b612-1ecbc24cc9ae -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:04 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-573556da-7464-4987-b612-1ecbc24cc9ae -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a Nov 02 10:54:04 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-573556da-7464-4987-b612-1ecbc24cc9ae -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a" returned: 0 in 0.275s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a is being set with open permissions: ugo+rw Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:05 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a Nov 02 10:54:05 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a" returned: 0 in 0.230s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:05 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info Nov 02 10:54:05 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info" returned: 0 in 0.238s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info is being set with open permissions: ugo+rw Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:05 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info Nov 02 10:54:05 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.info" returned: 0 in 0.236s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c84b2d63-6e24-4a34-acf0-1bfc340a2f0e tempest-SnapshotDependencyTests-1499260446 None] Create snapshot completed successfully Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Flow 'volume_create_manager' (3c448eec-7b70-4742-ab68-0137a5cbf4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7eaeff6-eb71-43e4-8afe-f94f0bba57ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7eaeff6-eb71-43e4-8afe-f94f0bba57ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9734a5-8352-4b50-94f7-c6dce8babff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7563cbf5fad4a828598e9a4defa6f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e6a03d8-7ced-48a1-bc4d-161642fac72a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:07Z,use_quota=True,user_id='b258a1a8c4444407854686eacc176816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ed3350-4d29-433e-b88f-a49531cbc9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ed3350-4d29-433e-b88f-a49531cbc9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db691cf9-38fb-4af5-ba64-67ccc2b47db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db691cf9-38fb-4af5-ba64-67ccc2b47db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db9734a5-8352-4b50-94f7-c6dce8babff2', 'volume_name': 'volume-db9734a5-8352-4b50-94f7-c6dce8babff2', 'volume_size': 1, 'snapshot_id': '0e6a03d8-7ced-48a1-bc4d-161642fac72a'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca19b862-4f07-48d4-809e-3fe0a9a33981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca19b862-4f07-48d4-809e-3fe0a9a33981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015762b0-0722-4c96-ad83-9a8af9867ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Volume db9734a5-8352-4b50-94f7-c6dce8babff2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db9734a5-8352-4b50-94f7-c6dce8babff2', 'volume_size': 1, 'snapshot_id': '0e6a03d8-7ced-48a1-bc4d-161642fac72a'} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-quobyte-0e6a03d8-7ced-48a1-bc4d-161642fac72a-db9734a5-8352-4b50-94f7-c6dce8babff2" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-0e6a03d8-7ced-48a1-bc4d-161642fac72a-db9734a5-8352-4b50-94f7-c6dce8babff2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Creating volume db9734a5-8352-4b50-94f7-c6dce8babff2 from snapshot 0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-quobyte-db9734a5-8352-4b50-94f7-c6dce8babff2" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-db9734a5-8352-4b50-94f7-c6dce8babff2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] snapshot: 0e6a03d8-7ced-48a1-bc4d-161642fac72a, volume: db9734a5-8352-4b50-94f7-c6dce8babff2, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[144eb922-fe71-4c88-8733-b071293caaad]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:07 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a Nov 02 10:54:07 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:07 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a" returned: 0 in 0.345s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-573556da-7464-4987-b612-1ecbc24cc9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e17781-45c4-40d8-b0c9-11c8d2382d6d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:07 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae Nov 02 10:54:07 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:07 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:54:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:07 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 Nov 02 10:54:07 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2" returned: 0 in 5.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:54:13 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Converted 1024.00 MB image at 193.81 MB/s Nov 02 10:54:13 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 is being set with open permissions: ugo+rw Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:13 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 Nov 02 10:54:13 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2" returned: 0 in 0.230s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-db9734a5-8352-4b50-94f7-c6dce8babff2" released by "_copy_volume_from_snapshot" :: held 6.290s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-0e6a03d8-7ced-48a1-bc4d-161642fac72a-db9734a5-8352-4b50-94f7-c6dce8babff2" released by "_create_volume_from_snapshot" :: held 6.352s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.368s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015762b0-0722-4c96-ad83-9a8af9867ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9734a5-8352-4b50-94f7-c6dce8babff2', 'volume_size': 1, 'snapshot_id': '0e6a03d8-7ced-48a1-bc4d-161642fac72a'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e695414b-07c8-47a3-9e98-64e42813f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:13 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Volume volume-db9734a5-8352-4b50-94f7-c6dce8babff2 (db9734a5-8352-4b50-94f7-c6dce8babff2): created successfully Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e695414b-07c8-47a3-9e98-64e42813f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Flow 'volume_create_manager' (3c448eec-7b70-4742-ab68-0137a5cbf4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1fa4957b-05c8-4eed-ad0f-e29aa508e766 tempest-SnapshotDependencyTests-1499260446 None] Created volume successfully. Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-0e6a03d8-7ced-48a1-bc4d-161642fac72a-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-0e6a03d8-7ced-48a1-bc4d-161642fac72a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-quobyte-573556da-7464-4987-b612-1ecbc24cc9ae" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-573556da-7464-4987-b612-1ecbc24cc9ae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-quobyte-0e6a03d8-7ced-48a1-bc4d-161642fac72a" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-0e6a03d8-7ced-48a1-bc4d-161642fac72a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Deleting offline snapshot 0e6a03d8-7ced-48a1-bc4d-161642fac72a of volume 573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] snapshot_file for this snap is: volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f1629-f483-4562-87de-745ea5ceffe1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a Nov 02 10:54:14 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:14 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-573556da-7464-4987-b612-1ecbc24cc9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870fe01-a159-4647-b85f-af1bd0dca331]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae Nov 02 10:54:14 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae" returned: 0 in 0.494s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a Nov 02 10:54:15 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a" returned: 0 in 0.303s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a Nov 02 10:54:15 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae.0e6a03d8-7ced-48a1-bc4d-161642fac72a" returned: 0 in 0.232s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-0e6a03d8-7ced-48a1-bc4d-161642fac72a" released by "_delete_snapshot" :: held 1.466s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-573556da-7464-4987-b612-1ecbc24cc9ae" released by "delete_snapshot" :: held 1.485s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Created reservations ['ec3b1e80-2911-4c7c-a472-eb26c31df14f', '38a06723-ab8c-49a2-9c8e-616531f191ca', '19cd8eb0-b0cf-4d7e-99f0-2e913c5b1f45', '19172536-ad28-4b0b-a88e-fa3c07e29ab5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Delete snapshot completed successfully. Nov 02 10:54:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-780091b4-253f-49f7-8964-ae276e74ec7d tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-0e6a03d8-7ced-48a1-bc4d-161642fac72a-delete_snapshot" released by "delete_snapshot" :: held 1.602s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-573556da-7464-4987-b612-1ecbc24cc9ae-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-573556da-7464-4987-b612-1ecbc24cc9ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-quobyte-573556da-7464-4987-b612-1ecbc24cc9ae" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-573556da-7464-4987-b612-1ecbc24cc9ae" acquired by "delete_volume" :: waited 0.012s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ac9a9-12f2-4c88-b6d1-53516019d210]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae Nov 02 10:54:16 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae" returned: 0 in 0.335s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae Nov 02 10:54:16 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-573556da-7464-4987-b612-1ecbc24cc9ae" returned: 0 in 0.231s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-573556da-7464-4987-b612-1ecbc24cc9ae" released by "delete_volume" :: held 0.624s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=79,cinder:UPDATE=82,cinder:DELETE=9,cinder:INSERT=22 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=75,cinder:UPDATE=87,cinder:INSERT=29,cinder:DELETE=6 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Created reservations ['8a3d524b-7abf-4bec-8478-8e2b9186e26b', '2736466a-2a24-48bc-9041-59cd1f695bf0', '5505a819-fe15-4dec-991f-c54c8e5f526a', '38abd83a-04bd-4ebb-bc63-5c9852754b20'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:17 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.228s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Deleted volume successfully. Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fddbb21a-ca15-4925-9d3e-2ca83852c878 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-573556da-7464-4987-b612-1ecbc24cc9ae-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-db9734a5-8352-4b50-94f7-c6dce8babff2-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-db9734a5-8352-4b50-94f7-c6dce8babff2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "cinder-quobyte-db9734a5-8352-4b50-94f7-c6dce8babff2" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-db9734a5-8352-4b50-94f7-c6dce8babff2" acquired by "delete_volume" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd71a8fb-5bab-4d35-a0b9-6b7e280501fc]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 Nov 02 10:54:17 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:18 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2 Nov 02 10:54:18 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-db9734a5-8352-4b50-94f7-c6dce8babff2" returned: 0 in 0.232s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-quobyte-db9734a5-8352-4b50-94f7-c6dce8babff2" released by "delete_volume" :: held 0.610s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Created reservations ['6ec668e8-a165-4588-924d-f541125e5dc5', '675c7a91-6885-4fda-8f82-f9ffc81dcdc9', 'b443e5bd-2b40-45e0-896f-94ee720a0954', '4c21cf61-090d-4fd9-bda9-ab2075be0504'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:18 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:18 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.232s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Deleted volume successfully. Nov 02 10:54:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-7cd717b9-8b32-41e2-beb3-f8b76ba5fb30 tempest-SnapshotDependencyTests-1499260446 None] Lock "cinder-db9734a5-8352-4b50-94f7-c6dce8babff2-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:22 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:22 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:22 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.245s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:54:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:54:28 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=9,cinder:INSERT=6,cinder:UPDATE=18 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:28 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=13,cinder:DELETE=2,cinder:SELECT=7,cinder:INSERT=2 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (c72837d1-3fa5-4eab-9a31-629151263f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1da95ba-38e3-4a82-9530-abce4519a6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1da95ba-38e3-4a82-9530-abce4519a6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712495361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e54dd1f-a27e-4814-8f8f-6666ec2adb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:39Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ccead5-4467-450e-b541-ca04f11ac6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ccead5-4467-450e-b541-ca04f11ac6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cbb9c9-6316-414b-922a-4e4fe0a67736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cbb9c9-6316-414b-922a-4e4fe0a67736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e54dd1f-a27e-4814-8f8f-6666ec2adb6b', 'volume_name': 'volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4773585-6da1-44dc-85f4-13b9306f3312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4773585-6da1-44dc-85f4-13b9306f3312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34b73d1-3f38-4d3f-9253-8940126fa178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Volume 3e54dd1f-a27e-4814-8f8f-6666ec2adb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b', 'volume_size': 1} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712495361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e54dd1f-a27e-4814-8f8f-6666ec2adb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:39Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Creating volume 3e54dd1f-a27e-4814-8f8f-6666ec2adb6b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:39 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:39 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b 1073741824 Nov 02 10:54:39 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (656ae9db-3451-47c9-8805-fc35a8446fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134be5d6-dda7-4a56-94e3-d642707082d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134be5d6-dda7-4a56-94e3-d642707082d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822544342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18886267-ef4a-4aeb-baed-a144ee0f8be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:39Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e00b56d-447c-4c5c-9466-d5539f1c71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e00b56d-447c-4c5c-9466-d5539f1c71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e59b1d0-1bd0-40e4-9c57-ef8405006d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e59b1d0-1bd0-40e4-9c57-ef8405006d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18886267-ef4a-4aeb-baed-a144ee0f8be8', 'volume_name': 'volume-18886267-ef4a-4aeb-baed-a144ee0f8be8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae78457-529f-42ee-a535-87a2f1d00c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae78457-529f-42ee-a535-87a2f1d00c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15acfdbe-9c15-4d4e-b683-fd1f71c863ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume 18886267-ef4a-4aeb-baed-a144ee0f8be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18886267-ef4a-4aeb-baed-a144ee0f8be8', 'volume_size': 1} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (59310be2-017b-471b-92f0-b42848cc613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6347433-2549-49a9-bf03-f5d43c4c7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6347433-2549-49a9-bf03-f5d43c4c7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-110151111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25345837-dc5c-4667-ab51-b60d538b3104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:39Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700c1df0-37a9-4846-a3d2-f7f427517713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700c1df0-37a9-4846-a3d2-f7f427517713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9355a8-2056-4526-8f76-b785ee121e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9355a8-2056-4526-8f76-b785ee121e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25345837-dc5c-4667-ab51-b60d538b3104', 'volume_name': 'volume-25345837-dc5c-4667-ab51-b60d538b3104', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f50b99-95bc-4a21-b7e2-d03f6ea0ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f50b99-95bc-4a21-b7e2-d03f6ea0ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5113490c-b268-4c02-a5fc-932a371842b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Volume 25345837-dc5c-4667-ab51-b60d538b3104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25345837-dc5c-4667-ab51-b60d538b3104', 'volume_size': 1} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:39 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (19a8dff3-3f4c-4e44-bf37-5d1a03a8125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afe92b1-5665-4f6a-b032-484476161dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b 1073741824" returned: 0 in 0.745s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afe92b1-5665-4f6a-b032-484476161dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-937588139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca65bdf9-63e2-4e28-b329-d5e2bc9209f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f644db-940b-4fcf-9ed8-8d9455fc33f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f644db-940b-4fcf-9ed8-8d9455fc33f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd5e734-a15a-4f89-95e3-cee17e0040f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd5e734-a15a-4f89-95e3-cee17e0040f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca65bdf9-63e2-4e28-b329-d5e2bc9209f3', 'volume_name': 'volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ee405-443a-4204-8d1c-fbeee9ead9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ee405-443a-4204-8d1c-fbeee9ead9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0244ba5d-36d8-4a44-a25f-4167a433e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Volume ca65bdf9-63e2-4e28-b329-d5e2bc9209f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3', 'volume_size': 1} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:39 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b Nov 02 10:54:39 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:40 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b" returned: 0 in 0.315s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822544342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18886267-ef4a-4aeb-baed-a144ee0f8be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:39Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating volume 18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:40 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34b73d1-3f38-4d3f-9253-8940126fa178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 1073741824 Nov 02 10:54:40 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16a7ee6-ff42-4c3c-8c24-fd1ee1a21132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Volume volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b (3e54dd1f-a27e-4814-8f8f-6666ec2adb6b): created successfully Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16a7ee6-ff42-4c3c-8c24-fd1ee1a21132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (c72837d1-3fa5-4eab-9a31-629151263f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (dfbd2384-a263-441a-97a7-ea022436eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83776a9-f750-40b5-a982-b31afa4adce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-cfd9f56d-21aa-4e45-8f9c-70964a0b70dd tempest-CreateVolumesFromImageTest-1231896329 None] Created volume successfully. Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83776a9-f750-40b5-a982-b31afa4adce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278133276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df07b5a0-47a2-4e3c-84c8-552345aca083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e1454a-e3d1-4188-aa7e-8c32564c4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e1454a-e3d1-4188-aa7e-8c32564c4c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12be9f7-54f3-4f98-af66-644b751c8523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12be9f7-54f3-4f98-af66-644b751c8523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df07b5a0-47a2-4e3c-84c8-552345aca083', 'volume_name': 'volume-df07b5a0-47a2-4e3c-84c8-552345aca083', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ef5116-0421-4a94-8b6c-c1fa85f4c40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ef5116-0421-4a94-8b6c-c1fa85f4c40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cac3f9-63c6-49f2-a967-633a36ef17b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Volume df07b5a0-47a2-4e3c-84c8-552345aca083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df07b5a0-47a2-4e3c-84c8-552345aca083', 'volume_size': 1} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (615e2b6b-6bbd-4b89-a110-86eaee6c8ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6f6a60-d8da-4dd4-8896-deb1a0731747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6f6a60-d8da-4dd4-8896-deb1a0731747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-26781973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f41869f-5a82-4844-bc72-ac9cecc2c3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:41Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2c7682-6adf-4172-a050-6043a2917b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2c7682-6adf-4172-a050-6043a2917b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b330b-e592-463d-bca3-c4e7994bae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b330b-e592-463d-bca3-c4e7994bae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f41869f-5a82-4844-bc72-ac9cecc2c3c0', 'volume_name': 'volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121afc32-c23a-44fa-982a-df979205b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121afc32-c23a-44fa-982a-df979205b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f86bd1-49ff-4951-a806-1ab8b20bdafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Volume 2f41869f-5a82-4844-bc72-ac9cecc2c3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0', 'volume_size': 1} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 1073741824" returned: 0 in 0.693s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:41 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 Nov 02 10:54:41 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:41 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8" returned: 0 in 0.270s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-110151111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25345837-dc5c-4667-ab51-b60d538b3104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:39Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Creating volume 25345837-dc5c-4667-ab51-b60d538b3104 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:41 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15acfdbe-9c15-4d4e-b683-fd1f71c863ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18886267-ef4a-4aeb-baed-a144ee0f8be8', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b9d435-92f6-4fdc-80df-c7bbda56edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:41 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 1073741824 Nov 02 10:54:41 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 (18886267-ef4a-4aeb-baed-a144ee0f8be8): created successfully Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b9d435-92f6-4fdc-80df-c7bbda56edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (656ae9db-3451-47c9-8805-fc35a8446fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1de19a1a-c26b-48c9-ba89-5c8e214e8b7e tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created volume successfully. Nov 02 10:54:41 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 1073741824" returned: 0 in 0.509s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:41 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 Nov 02 10:54:41 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104" returned: 0 in 0.321s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.294s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-937588139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca65bdf9-63e2-4e28-b329-d5e2bc9209f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Creating volume ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:42 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5113490c-b268-4c02-a5fc-932a371842b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25345837-dc5c-4667-ab51-b60d538b3104', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 1073741824 Nov 02 10:54:42 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed10482e-0058-49d8-8f15-4e296f1e8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Flow 'volume_create_manager' (52e51900-caa3-420e-8081-996c7f4499b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefb6f2d-f4c0-4588-b54d-bc94eb9472f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Volume volume-25345837-dc5c-4667-ab51-b60d538b3104 (25345837-dc5c-4667-ab51-b60d538b3104): created successfully Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed10482e-0058-49d8-8f15-4e296f1e8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (59310be2-017b-471b-92f0-b42848cc613c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefb6f2d-f4c0-4588-b54d-bc94eb9472f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e5ddca-3a91-4384-a348-91b38ad57384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12951585e8704ce3916d63e47fd0ebee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:42Z,use_quota=True,user_id='90df7be504fe426089145bf279218b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5257feb1-3876-42fd-a27e-e27ca5b911e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5257feb1-3876-42fd-a27e-e27ca5b911e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075b1d36-7578-4292-b714-ee04513b3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:54:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3baf669f-2f76-4cd8-935c-0122eb48c8df tempest-CreateVolumesFromImageTest-1231896329 None] Created volume successfully. Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075b1d36-7578-4292-b714-ee04513b3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17e5ddca-3a91-4384-a348-91b38ad57384', 'volume_name': 'volume-17e5ddca-3a91-4384-a348-91b38ad57384', 'volume_size': 1, 'image_id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8710a628-fa6d-413b-8516-8f7af18f7e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd682de01a77bd611f063bbf14576c42c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12951585e8704ce3916d63e47fd0ebee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ab3cb39c553514761d487488f991862061c879d2e44d0596985e77df71f48b313833334ad3d38898a552e2f1af9247e9a71184fe9966ebbe08fe50d8a111018', 'id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'created_at': datetime.datetime(2026, 11, 2, 9, 54, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 54, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8710a628-fa6d-413b-8516-8f7af18f7e6e/file', 'properties': {}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3223516-dd41-4a7b-be9c-09797f203eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3223516-dd41-4a7b-be9c-09797f203eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f298ce8-2b14-49d7-98ef-fde91fd73dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Volume 17e5ddca-3a91-4384-a348-91b38ad57384: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17e5ddca-3a91-4384-a348-91b38ad57384', 'volume_size': 1, 'image_id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8710a628-fa6d-413b-8516-8f7af18f7e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd682de01a77bd611f063bbf14576c42c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12951585e8704ce3916d63e47fd0ebee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ab3cb39c553514761d487488f991862061c879d2e44d0596985e77df71f48b313833334ad3d38898a552e2f1af9247e9a71184fe9966ebbe08fe50d8a111018', 'id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'created_at': datetime.datetime(2026, 11, 2, 9, 54, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 54, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8710a628-fa6d-413b-8516-8f7af18f7e6e/file', 'properties': {}}, 'image_service': } Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Trying to clone 17e5ddca-3a91-4384-a348-91b38ad57384 from image 8710a628-fa6d-413b-8516-8f7af18f7e6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8710a628-fa6d-413b-8516-8f7af18f7e6e', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:54:42 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 1073741824" returned: 0 in 0.548s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:54:42 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 Nov 02 10:54:42 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a82d01-b2de-4b63-a2a6-11d229e9a82e]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD Nov 02 10:54:43 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3" returned: 0 in 0.350s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.601s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278133276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df07b5a0-47a2-4e3c-84c8-552345aca083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Creating volume df07b5a0-47a2-4e3c-84c8-552345aca083 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:43 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 1073741824 Nov 02 10:54:43 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0244ba5d-36d8-4a44-a25f-4167a433e34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfb94f7-046f-42b9-924a-1534b7102f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Volume volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 (ca65bdf9-63e2-4e28-b329-d5e2bc9209f3): created successfully Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfb94f7-046f-42b9-924a-1534b7102f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (19a8dff3-3f4c-4e44-bf37-5d1a03a8125f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Flow 'volume_create_manager' (7834a986-9e6b-474a-bed9-a04e8ebcd941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a0590f-8442-4d68-84aa-442773a0c9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-934fbb3c-9f80-4650-8345-d405a1bd4e7c tempest-CreateVolumesFromImageTest-1231896329 None] Created volume successfully. Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a0590f-8442-4d68-84aa-442773a0c9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f844581b-706a-40a4-a3d9-7972000ec646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1621563c41d4548bca73231a214f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:43Z,use_quota=True,user_id='025cbb8752674ec6bee152790d2fea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92a1f1d1-991b-46e8-a9f1-251f522ac578),volume_type_id=92a1f1d1-991b-46e8-a9f1-251f522ac578)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4639051c-cf0e-488c-a678-fd4d99972f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4639051c-cf0e-488c-a678-fd4d99972f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a760032-2960-45b4-8a34-ea388d773969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.image.glance [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Creating Keystone auth plugin from conf {{(pid=86926) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:54:43 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD Nov 02 10:54:43 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a760032-2960-45b4-8a34-ea388d773969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f844581b-706a-40a4-a3d9-7972000ec646', 'volume_name': 'volume-f844581b-706a-40a4-a3d9-7972000ec646', 'volume_size': 1, 'image_id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c8ce89b57c3647ec205387302e3e4fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1621563c41d4548bca73231a214f221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a57ebcf1187bf50a5e1d013312cb015b73e9062300649c05ad092efa8007c4b854b5f2efcd43e412e1de6a02d5cd1b7f110aea066a8a5a0314feeea32c7f3aa', 'id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'created_at': datetime.datetime(2026, 11, 2, 9, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909fda58-ca88-4e1e-92a5-72e94dd89217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909fda58-ca88-4e1e-92a5-72e94dd89217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df428f5f-eb04-4d65-b89c-4924020d2c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Volume f844581b-706a-40a4-a3d9-7972000ec646: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f844581b-706a-40a4-a3d9-7972000ec646', 'volume_size': 1, 'image_id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c8ce89b57c3647ec205387302e3e4fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1621563c41d4548bca73231a214f221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a57ebcf1187bf50a5e1d013312cb015b73e9062300649c05ad092efa8007c4b854b5f2efcd43e412e1de6a02d5cd1b7f110aea066a8a5a0314feeea32c7f3aa', 'id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'created_at': datetime.datetime(2026, 11, 2, 9, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Trying to clone f844581b-706a-40a4-a3d9-7972000ec646 from image 1b5ca7db-17ae-42c5-be53-c5463dcbd663 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'metadata': {}}]). {{(pid=86926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:54:43 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD" returned: 1 in 0.400s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Temporary image 8710a628-fa6d-413b-8516-8f7af18f7e6e is fetched for user 90df7be504fe426089145bf279218b03. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:54:43 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:54:43 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 1073741824" returned: 0 in 0.559s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0943c66-c41d-42ab-a227-02eb2cdecd3b]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[461bf6f5-1361-443d-8d53-4a919942d7c2]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 Nov 02 10:54:43 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD Nov 02 10:54:43 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD Nov 02 10:54:43 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083" returned: 0 in 0.343s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.179s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-26781973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f41869f-5a82-4844-bc72-ac9cecc2c3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6956799441147d58d183ff555db8970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:41Z,use_quota=True,user_id='fefdf25e95a548efb5e67df2ec633595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Creating volume 2f41869f-5a82-4844-bc72-ac9cecc2c3c0 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:44 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 1073741824 Nov 02 10:54:44 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cac3f9-63c6-49f2-a967-633a36ef17b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df07b5a0-47a2-4e3c-84c8-552345aca083', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854fadd7-0c56-41a5-9bd6-7852a994409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Volume volume-df07b5a0-47a2-4e3c-84c8-552345aca083 (df07b5a0-47a2-4e3c-84c8-552345aca083): created successfully Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854fadd7-0c56-41a5-9bd6-7852a994409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:44 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (dfbd2384-a263-441a-97a7-ea022436eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:44 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-7b1c9881-8435-442e-af54-6378cce1283a tempest-CreateVolumesFromImageTest-1231896329 None] Created volume successfully. Nov 02 10:54:44 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD Nov 02 10:54:44 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Temporary image 1b5ca7db-17ae-42c5-be53-c5463dcbd663 is fetched for user 025cbb8752674ec6bee152790d2fea83. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1b2a5f-646f-4932-a73b-f62fb833ef8f]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:44 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 1073741824" returned: 0 in 0.455s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 Nov 02 10:54:44 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD Nov 02 10:54:44 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.474s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f86bd1-49ff-4951-a806-1ab8b20bdafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ae9b13-a0eb-4eff-b3a6-d0b6803e4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating offline snapshot 13efc182-d68b-4b26-8f3b-6407c788bcb7 of volume 18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:54:45 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD Nov 02 10:54:45 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Volume volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 (2f41869f-5a82-4844-bc72-ac9cecc2c3c0): created successfully Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ae9b13-a0eb-4eff-b3a6-d0b6803e4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Flow 'volume_create_manager' (615e2b6b-6bbd-4b89-a110-86eaee6c8ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc35e818-10ee-45bf-a074-06174a600872]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a56000be-c50f-4520-98a5-caec4a973500 tempest-CreateVolumesFromImageTest-1231896329 None] Created volume successfully. Nov 02 10:54:45 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 Nov 02 10:54:45 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-2f41869f-5a82-4844-bc72-ac9cecc2c3c0-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-2f41869f-5a82-4844-bc72-ac9cecc2c3c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-quobyte-2f41869f-5a82-4844-bc72-ac9cecc2c3c0" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:45 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8" returned: 0 in 0.430s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-2f41869f-5a82-4844-bc72-ac9cecc2c3c0" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:45 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 1G Nov 02 10:54:45 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e209188f-9f21-495d-af2f-c15fe0a2e019]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 Nov 02 10:54:45 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 1G" returned: 0 in 0.395s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0" returned: 0 in 0.364s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 Nov 02 10:54:45 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0 Nov 02 10:54:45 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2f41869f-5a82-4844-bc72-ac9cecc2c3c0" returned: 0 in 0.248s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-2f41869f-5a82-4844-bc72-ac9cecc2c3c0" released by "delete_volume" :: held 0.661s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7" returned: 0 in 0.291s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 is being set with open permissions: ugo+rw Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 Nov 02 10:54:46 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Created reservations ['ddf74fab-45ae-43cc-8a23-09690a0cc2c8', 'dcfbffbc-f1c5-4ada-bad7-ec6b4bf35005', 'c6b37c36-3960-4293-b017-c12f9e61f09c', 'a98b3a90-80e3-470e-9270-98d5fbe0ba43'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:46 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7" returned: 0 in 0.265s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info Nov 02 10:54:46 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.283s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Deleted volume successfully. Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0829a936-a623-4025-a206-75ce3fc254ea tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-2f41869f-5a82-4844-bc72-ac9cecc2c3c0-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-df07b5a0-47a2-4e3c-84c8-552345aca083-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-df07b5a0-47a2-4e3c-84c8-552345aca083-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-quobyte-df07b5a0-47a2-4e3c-84c8-552345aca083" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-df07b5a0-47a2-4e3c-84c8-552345aca083" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[34077234-beca-43b5-8102-d94c3ba27e1d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info" returned: 0 in 0.272s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info is being set with open permissions: ugo+rw Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info Nov 02 10:54:46 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 Nov 02 10:54:46 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.info" returned: 0 in 0.247s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e5ddca-3a91-4384-a348-91b38ad57384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12951585e8704ce3916d63e47fd0ebee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:42Z,use_quota=True,user_id='90df7be504fe426089145bf279218b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Creating volume 17e5ddca-3a91-4384-a348-91b38ad57384 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:47 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 1073741824 Nov 02 10:54:47 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bf3f04d3-bded-49d6-a47f-b8782c74a21b tempest-CreateVolumesFromSnapshotTest-1473881793 None] Create snapshot completed successfully Nov 02 10:54:47 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083 Nov 02 10:54:47 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-df07b5a0-47a2-4e3c-84c8-552345aca083" returned: 0 in 0.263s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-df07b5a0-47a2-4e3c-84c8-552345aca083" released by "delete_volume" :: held 0.681s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Created reservations ['31a1640d-b62e-4cab-96d5-de2880f3655a', '4baf84cb-f1dd-4bee-9dd2-123b9d2d5407', '114fb62a-f0c8-4b7c-a276-24545d40ea5f', 'b19ae203-9ed0-4e27-8f33-7566ddc0f7cf'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 1073741824" returned: 0 in 0.485s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:47 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 Nov 02 10:54:47 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.268s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Deleted volume successfully. Nov 02 10:54:47 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384" returned: 0 in 0.268s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.561s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f844581b-706a-40a4-a3d9-7972000ec646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1621563c41d4548bca73231a214f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:43Z,use_quota=True,user_id='025cbb8752674ec6bee152790d2fea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92a1f1d1-991b-46e8-a9f1-251f522ac578),volume_type_id=92a1f1d1-991b-46e8-a9f1-251f522ac578)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Creating volume f844581b-706a-40a4-a3d9-7972000ec646 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:47 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f84fc767-629a-481f-b564-a8e8067497bc tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-df07b5a0-47a2-4e3c-84c8-552345aca083-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 1073741824 Nov 02 10:54:47 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Attempting download of 8710a628-fa6d-413b-8516-8f7af18f7e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/8710a628-fa6d-413b-8516-8f7af18f7e6e', 'metadata': {}}])) to volume 17e5ddca-3a91-4384-a348-91b38ad57384. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-quobyte-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[141292c2-3b82-4a6f-865f-55479a5150e7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef7c835-332b-4859-be68-e31f46dc5b08]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b Nov 02 10:54:48 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 Nov 02 10:54:48 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (eb3a0a83-dd34-4470-883a-ebe4f211c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d437dd11-6c20-419b-ad15-399eec9722eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d437dd11-6c20-419b-ad15-399eec9722eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797927751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7df45e-b9e1-4826-8bb6-820fb3870374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:48Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f35d22-3bf2-4331-a232-9892684bfb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f35d22-3bf2-4331-a232-9892684bfb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3270ebe7-736e-4de3-91c0-50a19b8967eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3270ebe7-736e-4de3-91c0-50a19b8967eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7df45e-b9e1-4826-8bb6-820fb3870374', 'volume_name': 'volume-7a7df45e-b9e1-4826-8bb6-820fb3870374', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf94517-3257-4ff9-ad9e-b8be73f70405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf94517-3257-4ff9-ad9e-b8be73f70405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd950c96-52c7-421f-8214-678922fc1a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume 7a7df45e-b9e1-4826-8bb6-820fb3870374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7df45e-b9e1-4826-8bb6-820fb3870374', 'volume_size': 1} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b" returned: 0 in 0.457s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3" returned: 0 in 0.497s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 1073741824" returned: 0 in 0.688s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3 Nov 02 10:54:48 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 Nov 02 10:54:48 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b Nov 02 10:54:48 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (ecf9fedd-dce4-4f4a-a132-cfe2dfc6ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92de3204-7d64-47e2-80e7-33038beeb749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92de3204-7d64-47e2-80e7-33038beeb749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147760853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c44b01-133d-4e03-908a-a07ae987b8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:49Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5b6497-1589-416a-91e8-49cfcea711ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5b6497-1589-416a-91e8-49cfcea711ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92de0564-8d69-469c-a508-87988a670d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92de0564-8d69-469c-a508-87988a670d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c44b01-133d-4e03-908a-a07ae987b8d0', 'volume_name': 'volume-71c44b01-133d-4e03-908a-a07ae987b8d0', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6281985e-0387-453a-bc18-f6595e1c6481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6281985e-0387-453a-bc18-f6595e1c6481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79d3215-012e-40fb-8db2-8ef62e3741bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume 71c44b01-133d-4e03-908a-a07ae987b8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c44b01-133d-4e03-908a-a07ae987b8d0', 'volume_size': 1} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b" returned: 1 in 0.460s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8710a628-fa6d-413b-8516-8f7af18f7e6e__fibwg4b' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[86621113-8220-492b-a324-c3fb000f2f00]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3" released by "delete_volume" :: held 1.007s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:49 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646" returned: 0 in 0.435s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797927751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7df45e-b9e1-4826-8bb6-820fb3870374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:48Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating volume 7a7df45e-b9e1-4826-8bb6-820fb3870374 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:49 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Created reservations ['9f3fe267-4c0a-472f-8ad1-73c7d08d9bbc', 'ee7509f7-13aa-4726-be44-0adc6b8b510f', 'a050c2ce-a759-4a16-850c-f8a0be234dcd', '65eae4bd-df21-4c0c-adb1-7f28e577a3c0'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:49 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 1073741824 Nov 02 10:54:49 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Attempting download of 1b5ca7db-17ae-42c5-be53-c5463dcbd663 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'metadata': {}}])) to volume f844581b-706a-40a4-a3d9-7972000ec646. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:54:49 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD Nov 02 10:54:49 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9910c-4c6e-4451-860c-806e11533cd7]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:49 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:49 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (f52f2e11-6258-49e2-b8fe-27f06dbd971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff1d27a-f45d-4835-a804-943997c6fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff1d27a-f45d-4835-a804-943997c6fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1274977428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdb77ce-20cc-4938-b3e5-4eb50acfac87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:49Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9085f05-475e-4579-bf55-712fc1c2bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9085f05-475e-4579-bf55-712fc1c2bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2ab008-6f79-44bd-848c-6588edb62ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2ab008-6f79-44bd-848c-6588edb62ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdb77ce-20cc-4938-b3e5-4eb50acfac87', 'volume_name': 'volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a9e44c-dbc1-477b-b2d4-1db70920eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a9e44c-dbc1-477b-b2d4-1db70920eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d66e76-e16c-4502-828e-eb33990fbea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume 2bdb77ce-20cc-4938-b3e5-4eb50acfac87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87', 'volume_size': 1} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD" returned: 0 in 0.672s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.415s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Deleted volume successfully. Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fd345cf2-22ae-4a5d-8705-345d36bd76ac tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-ca65bdf9-63e2-4e28-b329-d5e2bc9209f3-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:49 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD Nov 02 10:54:49 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly" returned: 0 in 0.660s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 1073741824" returned: 0 in 0.850s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (285a22d5-9052-4eb8-af56-62dd65fa52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec20303-87ee-4d09-bd62-374bccade43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec20303-87ee-4d09-bd62-374bccade43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170498545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8993129-52a6-4eac-94dc-226be5d5499b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:50Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438a650b-ac09-43ab-8852-1e2cf0c3d97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438a650b-ac09-43ab-8852-1e2cf0c3d97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a20381d-6dce-44af-bc17-137262a82ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly Nov 02 10:54:49 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a20381d-6dce-44af-bc17-137262a82ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8993129-52a6-4eac-94dc-226be5d5499b', 'volume_name': 'volume-b8993129-52a6-4eac-94dc-226be5d5499b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6153fed-31d2-479b-a5e4-cac22ca3afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6153fed-31d2-479b-a5e4-cac22ca3afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa41be-619a-4339-8ee1-24e266fcdb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume b8993129-52a6-4eac-94dc-226be5d5499b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8993129-52a6-4eac-94dc-226be5d5499b', 'volume_size': 1} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 Nov 02 10:54:50 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD" returned: 1 in 0.505s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] 8710a628-fa6d-413b-8516-8f7af18f7e6e was raw, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-25345837-dc5c-4667-ab51-b60d538b3104-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:50 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-25345837-dc5c-4667-ab51-b60d538b3104-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-quobyte-25345837-dc5c-4667-ab51-b60d538b3104" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-25345837-dc5c-4667-ab51-b60d538b3104" acquired by "delete_volume" :: waited 0.089s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:50 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly" returned: 1 in 0.583s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b5ca7db-17ae-42c5-be53-c5463dcbd663_7ju711ly' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f00181e-e195-4a10-8de2-c2d83fb85713]: (4, 'raw') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[25045e11-d853-4ee0-9262-c860dd3c03aa]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:50 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD Nov 02 10:54:50 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (88f368d3-7b1d-444a-b4af-83f6bdabbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf3d00f-8814-437d-9a02-ec526e05026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374" returned: 0 in 0.594s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147760853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c44b01-133d-4e03-908a-a07ae987b8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:49Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating volume 71c44b01-133d-4e03-908a-a07ae987b8d0 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:50 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf3d00f-8814-437d-9a02-ec526e05026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762537688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94372b6-c17e-452c-93c2-8144815ffd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:50Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 1073741824 Nov 02 10:54:50 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821066a7-0407-4c29-9f1c-27395c4bf6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821066a7-0407-4c29-9f1c-27395c4bf6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e863f-f8ba-48d5-b839-d858b44018c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e863f-f8ba-48d5-b839-d858b44018c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94372b6-c17e-452c-93c2-8144815ffd5b', 'volume_name': 'volume-f94372b6-c17e-452c-93c2-8144815ffd5b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f20b419-8f16-41b4-ab15-494cf4090cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f20b419-8f16-41b4-ab15-494cf4090cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5a4bdf-fc8d-4fbe-bd06-57c8b8eac2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume f94372b6-c17e-452c-93c2-8144815ffd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94372b6-c17e-452c-93c2-8144815ffd5b', 'volume_size': 1} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:50 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd950c96-52c7-421f-8214-678922fc1a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7df45e-b9e1-4826-8bb6-820fb3870374', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414f3c28-568d-44a9-88da-0e6f43566aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:50 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 (7a7df45e-b9e1-4826-8bb6-820fb3870374): created successfully Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414f3c28-568d-44a9-88da-0e6f43566aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (eb3a0a83-dd34-4470-883a-ebe4f211c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fbc20c38-dc4c-49c1-85f3-7bf660deb28c tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created volume successfully. Nov 02 10:54:50 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384" returned: 0 in 0.859s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8710a628-fa6d-413b-8516-8f7af18f7e6e_vez9z_29devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:54:51 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 1G Nov 02 10:54:51 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104" returned: 0 in 0.637s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104 Nov 02 10:54:51 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 1073741824" returned: 0 in 0.573s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 Nov 02 10:54:51 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 1G" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Downloaded image 8710a628-fa6d-413b-8516-8f7af18f7e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/8710a628-fa6d-413b-8516-8f7af18f7e6e', 'metadata': {}}])) to volume 17e5ddca-3a91-4384-a348-91b38ad57384 successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Temporary image 8710a628-fa6d-413b-8516-8f7af18f7e6e for user 90df7be504fe426089145bf279218b03 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Marking volume 17e5ddca-3a91-4384-a348-91b38ad57384 as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Copying metadata from image 8710a628-fa6d-413b-8516-8f7af18f7e6e to 17e5ddca-3a91-4384-a348-91b38ad57384. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Creating volume glance metadata for volume 17e5ddca-3a91-4384-a348-91b38ad57384 backed by image 8710a628-fa6d-413b-8516-8f7af18f7e6e with: {'image_id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd682de01a77bd611f063bbf14576c42c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:54:51 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] 1b5ca7db-17ae-42c5-be53-c5463dcbd663 was raw, converting to qcow2 {{(pid=86926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-25345837-dc5c-4667-ab51-b60d538b3104" returned: 0 in 0.316s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 Nov 02 10:54:51 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-25345837-dc5c-4667-ab51-b60d538b3104" released by "delete_volume" :: held 1.095s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f298ce8-2b14-49d7-98ef-fde91fd73dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e5ddca-3a91-4384-a348-91b38ad57384', 'volume_size': 1, 'image_id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8710a628-fa6d-413b-8516-8f7af18f7e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd682de01a77bd611f063bbf14576c42c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12951585e8704ce3916d63e47fd0ebee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ab3cb39c553514761d487488f991862061c879d2e44d0596985e77df71f48b313833334ad3d38898a552e2f1af9247e9a71184fe9966ebbe08fe50d8a111018', 'id': '8710a628-fa6d-413b-8516-8f7af18f7e6e', 'created_at': datetime.datetime(2026, 11, 2, 9, 54, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 54, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8710a628-fa6d-413b-8516-8f7af18f7e6e/file', 'properties': {}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c711651-562f-49d4-9ce4-7c37db7f6c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:51 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Volume volume-17e5ddca-3a91-4384-a348-91b38ad57384 (17e5ddca-3a91-4384-a348-91b38ad57384): created successfully Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c711651-562f-49d4-9ce4-7c37db7f6c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Flow 'volume_create_manager' (52e51900-caa3-420e-8081-996c7f4499b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0" returned: 0 in 0.314s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1274977428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdb77ce-20cc-4938-b3e5-4eb50acfac87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:49Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating volume 2bdb77ce-20cc-4938-b3e5-4eb50acfac87 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:51 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1d3c3d8d-379d-4a31-a552-023f9dc732d3 tempest-VolumeImageDependencyTests-822792272 None] Created volume successfully. Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Created reservations ['0759b89a-66f8-4a82-81a3-ee60f6a10731', '70e04158-c401-4d68-9cbb-f0a20042729c', 'a4c157b2-5875-4b53-831f-86735efd07e6', '6996cdf4-0e4e-4830-8283-66af80add94b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:51 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 1073741824 Nov 02 10:54:51 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79d3215-012e-40fb-8db2-8ef62e3741bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c44b01-133d-4e03-908a-a07ae987b8d0', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990c6c3e-3158-402f-ac8b-ecefc54b2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume volume-71c44b01-133d-4e03-908a-a07ae987b8d0 (71c44b01-133d-4e03-908a-a07ae987b8d0): created successfully Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990c6c3e-3158-402f-ac8b-ecefc54b2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (ecf9fedd-dce4-4f4a-a132-cfe2dfc6ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6f4581cc-767c-47ae-bfc4-7a0522b65488 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created volume successfully. Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:51 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "cinder-quobyte-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[88015489-6288-4c43-9cc0-0d7ec7773aaa]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646" returned: 0 in 0.666s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b5ca7db-17ae-42c5-be53-c5463dcbd663_41drayrbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 1G Nov 02 10:54:52 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.419s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Deleted volume successfully. Nov 02 10:54:52 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 1073741824" returned: 0 in 0.561s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e4614806-2b5a-4394-9691-6a4f86df38c9 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-25345837-dc5c-4667-ab51-b60d538b3104-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Acquiring lock "cinder-17e5ddca-3a91-4384-a348-91b38ad57384-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:52 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b Nov 02 10:54:52 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Lock "cinder-17e5ddca-3a91-4384-a348-91b38ad57384-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Acquiring lock "cinder-quobyte-17e5ddca-3a91-4384-a348-91b38ad57384" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Lock "cinder-quobyte-17e5ddca-3a91-4384-a348-91b38ad57384" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df2eaa2-c35c-40ce-95bf-1ae6e2d27925]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 1G" returned: 0 in 0.406s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Downloaded image 1b5ca7db-17ae-42c5-be53-c5463dcbd663 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'metadata': {}}])) to volume f844581b-706a-40a4-a3d9-7972000ec646 successfully. {{(pid=86926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Temporary image 1b5ca7db-17ae-42c5-be53-c5463dcbd663 for user 025cbb8752674ec6bee152790d2fea83 is deleted. {{(pid=86926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.volume_utils [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Marking volume f844581b-706a-40a4-a3d9-7972000ec646 as bootable. {{(pid=86926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:54:52 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 Nov 02 10:54:52 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Copying metadata from image 1b5ca7db-17ae-42c5-be53-c5463dcbd663 to f844581b-706a-40a4-a3d9-7972000ec646. {{(pid=86926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Creating volume glance metadata for volume f844581b-706a-40a4-a3d9-7972000ec646 backed by image 1b5ca7db-17ae-42c5-be53-c5463dcbd663 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2c8ce89b57c3647ec205387302e3e4fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:54:52 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87" returned: 0 in 0.338s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170498545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8993129-52a6-4eac-94dc-226be5d5499b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:50Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating volume b8993129-52a6-4eac-94dc-226be5d5499b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:52 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b" returned: 0 in 0.512s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b 1073741824 Nov 02 10:54:52 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d66e76-e16c-4502-828e-eb33990fbea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973db56d-e9bc-40a1-a47d-a4875464e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 (2bdb77ce-20cc-4938-b3e5-4eb50acfac87): created successfully Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973db56d-e9bc-40a1-a47d-a4875464e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:52 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b Nov 02 10:54:52 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (f52f2e11-6258-49e2-b8fe-27f06dbd971e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-61041e71-13af-42fe-9f79-67fba1d47ba7 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created volume successfully. Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df428f5f-eb04-4d65-b89c-4924020d2c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f844581b-706a-40a4-a3d9-7972000ec646', 'volume_size': 1, 'image_id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c8ce89b57c3647ec205387302e3e4fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1621563c41d4548bca73231a214f221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a57ebcf1187bf50a5e1d013312cb015b73e9062300649c05ad092efa8007c4b854b5f2efcd43e412e1de6a02d5cd1b7f110aea066a8a5a0314feeea32c7f3aa', 'id': '1b5ca7db-17ae-42c5-be53-c5463dcbd663', 'created_at': datetime.datetime(2026, 11, 2, 9, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b5ca7db-17ae-42c5-be53-c5463dcbd663/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295a8a94-4181-4084-a50b-7680bf0667c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Volume volume-f844581b-706a-40a4-a3d9-7972000ec646 (f844581b-706a-40a4-a3d9-7972000ec646): created successfully Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295a8a94-4181-4084-a50b-7680bf0667c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Flow 'volume_create_manager' (7834a986-9e6b-474a-bed9-a04e8ebcd941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3dea6540-88c0-4bbd-ac90-abc3d781487c tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Created volume successfully. Nov 02 10:54:52 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384" returned: 0 in 0.536s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384 Nov 02 10:54:52 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-quobyte-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b" released by "delete_volume" :: held 0.912s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Created reservations ['9c5eb297-66f8-41b0-8ca5-300af32be72f', 'b95d3899-fca6-49cc-ab3b-371ee7b3c7e1', '44af2fbf-4dc2-4592-a4e3-e97b2f7d4c49', 'd530f2eb-1044-4b68-95fa-ecdfcc5f9ad8'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:53 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:53 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b 1073741824" returned: 0 in 0.597s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Acquiring lock "cinder-f844581b-706a-40a4-a3d9-7972000ec646-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "cinder-f844581b-706a-40a4-a3d9-7972000ec646-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:53 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b Nov 02 10:54:53 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:53 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-17e5ddca-3a91-4384-a348-91b38ad57384" returned: 0 in 0.398s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Acquiring lock "cinder-quobyte-f844581b-706a-40a4-a3d9-7972000ec646" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Lock "cinder-quobyte-17e5ddca-3a91-4384-a348-91b38ad57384" released by "delete_volume" :: held 1.011s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "cinder-quobyte-f844581b-706a-40a4-a3d9-7972000ec646" acquired by "delete_volume" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a482fd78-e637-43ae-a21d-894cd050171e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.327s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Deleted volume successfully. Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0ea5f34c-8918-494e-8836-fcde7fbc5462 tempest-CreateVolumesFromImageTest-1231896329 None] Lock "cinder-3e54dd1f-a27e-4814-8f8f-6666ec2adb6b-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Created reservations ['440188c4-153c-4113-a07c-9e6760830173', '8f5b84af-09c8-4863-a4f0-110a4ddc6608', '37f8cd7f-132a-405f-9d37-4913ae943357', '48287c42-cb50-4318-879d-09285c5bf6ca'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:53 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 Nov 02 10:54:53 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b" returned: 0 in 0.431s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.907s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762537688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94372b6-c17e-452c-93c2-8144815ffd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2983f66a903142119272e8967eb9333e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:50Z,use_quota=True,user_id='7ab6f2447a1b4259894ae825c98bebcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Creating volume f94372b6-c17e-452c-93c2-8144815ffd5b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:53 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:53 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa41be-619a-4339-8ee1-24e266fcdb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8993129-52a6-4eac-94dc-226be5d5499b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990843fa-e968-4663-b65b-09b47204d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:53 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b 1073741824 Nov 02 10:54:53 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:53 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume volume-b8993129-52a6-4eac-94dc-226be5d5499b (b8993129-52a6-4eac-94dc-226be5d5499b): created successfully Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990843fa-e968-4663-b65b-09b47204d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (285a22d5-9052-4eb8-af56-62dd65fa52a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-04e98357-d77a-46c0-b36a-121eb28d01f3 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created volume successfully. Nov 02 10:54:53 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.294s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Deleted volume successfully. Nov 02 10:54:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ee1b02da-7dc5-4c93-ae9e-fe5433e55ad2 tempest-VolumeImageDependencyTests-822792272 None] Lock "cinder-17e5ddca-3a91-4384-a348-91b38ad57384-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:54 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646" returned: 0 in 0.585s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:54 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646 Nov 02 10:54:54 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:54 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b 1073741824" returned: 0 in 0.625s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f844581b-706a-40a4-a3d9-7972000ec646" returned: 0 in 0.296s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "cinder-quobyte-f844581b-706a-40a4-a3d9-7972000ec646" released by "delete_volume" :: held 0.953s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:54 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b Nov 02 10:54:54 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Created reservations ['4e801c53-c2bb-46c6-9628-2c3cf4254a37', '2bc02a7c-e43c-41ad-8129-336c36527334', 'd5e782fb-6902-4b20-b43c-6f832bbdae0b', 'a261cb72-af13-4ed5-83f8-228c46881e2c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:54 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:54 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:54 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b" returned: 0 in 0.301s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5a4bdf-fc8d-4fbe-bd06-57c8b8eac2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94372b6-c17e-452c-93c2-8144815ffd5b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4648315-a51e-414f-94ae-86a629371353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:54 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Volume volume-f94372b6-c17e-452c-93c2-8144815ffd5b (f94372b6-c17e-452c-93c2-8144815ffd5b): created successfully Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4648315-a51e-414f-94ae-86a629371353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Flow 'volume_create_manager' (88f368d3-7b1d-444a-b4af-83f6bdabbfed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fb700252-0604-483a-87fa-a12ff8144c47 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created volume successfully. Nov 02 10:54:54 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.346s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Deleted volume successfully. Nov 02 10:54:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-49859cc7-a054-4120-997e-45aec80687c7 tempest-VolumeAndVolumeTypeFromImageTest-1425855176 None] Lock "cinder-f844581b-706a-40a4-a3d9-7972000ec646-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-f94372b6-c17e-452c-93c2-8144815ffd5b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-f94372b6-c17e-452c-93c2-8144815ffd5b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-f94372b6-c17e-452c-93c2-8144815ffd5b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-f94372b6-c17e-452c-93c2-8144815ffd5b" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d3169-2f4d-4d77-94e6-c60a9c4df141]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:55 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b Nov 02 10:54:55 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:55 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b" returned: 0 in 0.476s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:55 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b Nov 02 10:54:55 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:56 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f94372b6-c17e-452c-93c2-8144815ffd5b" returned: 0 in 0.365s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-f94372b6-c17e-452c-93c2-8144815ffd5b" released by "delete_volume" :: held 0.898s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['30a39226-3376-4d7b-917d-cca18ee907f6', 'edc6546a-cc39-4eca-a5c8-7f9d3762b115', '191e0606-7962-484c-9846-9ff5d7ee3280', '71b3dfe2-14e7-4a78-8c49-6bfda8664682'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:56 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:56 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-b8993129-52a6-4eac-94dc-226be5d5499b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-b8993129-52a6-4eac-94dc-226be5d5499b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-b8993129-52a6-4eac-94dc-226be5d5499b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-b8993129-52a6-4eac-94dc-226be5d5499b" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4062c2f0-af0b-4770-96e0-3a594081201f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:56 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:56 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleted volume successfully. Nov 02 10:54:56 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b Nov 02 10:54:56 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2be3ce08-a9e7-423e-aae5-ce8826a93345 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-f94372b6-c17e-452c-93c2-8144815ffd5b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:57 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b" returned: 0 in 0.506s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b Nov 02 10:54:57 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:57 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b8993129-52a6-4eac-94dc-226be5d5499b" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-b8993129-52a6-4eac-94dc-226be5d5499b" released by "delete_volume" :: held 0.859s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['bd76f177-c400-46b4-9d17-d113606b21d2', '6bee9021-a0f8-4de3-94ff-8854cf52e927', '5c09893a-2af4-4117-b76e-adde9888b777', 'a006264f-11f6-4996-b06a-d424598176b0'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:57 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-2bdb77ce-20cc-4938-b3e5-4eb50acfac87-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-2bdb77ce-20cc-4938-b3e5-4eb50acfac87-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (0178edbe-1a57-46b5-a0a9-6f61e0fc1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e51917-9db8-4d44-9c18-e62664c1e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e51917-9db8-4d44-9c18-e62664c1e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-813932671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a830259-d678-48c4-81cc-48c0ffddf1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:58Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f143db8f-3475-4ac9-abdb-b0f41c867f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f143db8f-3475-4ac9-abdb-b0f41c867f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d676cd6d-65e5-4c73-aa35-cecf686783dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d676cd6d-65e5-4c73-aa35-cecf686783dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a830259-d678-48c4-81cc-48c0ffddf1be', 'volume_name': 'volume-7a830259-d678-48c4-81cc-48c0ffddf1be', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9929270b-fea5-45d5-8ce6-64f71660702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9929270b-fea5-45d5-8ce6-64f71660702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28009fb6-2fd2-48da-b2a0-bbd7b9876b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume 7a830259-d678-48c4-81cc-48c0ffddf1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a830259-d678-48c4-81cc-48c0ffddf1be', 'volume_size': 1} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-813932671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a830259-d678-48c4-81cc-48c0ffddf1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:58Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Creating volume 7a830259-d678-48c4-81cc-48c0ffddf1be {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:57 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-2bdb77ce-20cc-4938-b3e5-4eb50acfac87" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:57 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be 1073741824 Nov 02 10:54:57 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-2bdb77ce-20cc-4938-b3e5-4eb50acfac87" acquired by "delete_volume" :: waited 0.038s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ec7c1-779a-41a5-a8d8-de00cf3392e9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:58 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.418s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleted volume successfully. Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-963deccf-c334-4a01-b52b-3dd5ecceb7ae tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-b8993129-52a6-4eac-94dc-226be5d5499b-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:58 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 Nov 02 10:54:58 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:58 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87" returned: 0 in 0.487s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:58 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87 Nov 02 10:54:58 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:58 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be 1073741824" returned: 0 in 0.698s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:58 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be Nov 02 10:54:58 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:58 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2bdb77ce-20cc-4938-b3e5-4eb50acfac87" returned: 0 in 0.356s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-2bdb77ce-20cc-4938-b3e5-4eb50acfac87" released by "delete_volume" :: held 0.939s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['4f7288bb-f01b-4a2c-bc27-41e1d2038b42', '0410f4e3-db9b-48ca-819d-7b9dc0d3ef11', '11afb74c-7bae-4f70-b8ab-b22497331b27', '5c106f04-b5b8-4bae-a5a7-9f8006c4a417'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:59 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be" returned: 0 in 0.418s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28009fb6-2fd2-48da-b2a0-bbd7b9876b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a830259-d678-48c4-81cc-48c0ffddf1be', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396192f7-75c1-400b-9ea6-a0f19dcff702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Flow 'volume_create_manager' (b15ae94a-5136-40da-b97b-a93fcf72d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a03216-b67e-453d-8608-ebeda3c9ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume volume-7a830259-d678-48c4-81cc-48c0ffddf1be (7a830259-d678-48c4-81cc-48c0ffddf1be): created successfully Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396192f7-75c1-400b-9ea6-a0f19dcff702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (0178edbe-1a57-46b5-a0a9-6f61e0fc1db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a03216-b67e-453d-8608-ebeda3c9ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b71e9b2-9d12-4143-b6dd-785279c6e7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99cf49266b3419e809bc3992516576b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:59Z,use_quota=True,user_id='7b6db7d0d886460aab30860ae723b905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6979124-8dc7-4dfb-84c7-f1f47422ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6979124-8dc7-4dfb-84c7-f1f47422ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ce24dd-08b4-4341-a501-7ffaf60d33c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ce24dd-08b4-4341-a501-7ffaf60d33c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b71e9b2-9d12-4143-b6dd-785279c6e7c1', 'volume_name': 'volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884a319c-f32d-49a8-a22e-e771f7fbd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884a319c-f32d-49a8-a22e-e771f7fbd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656125f0-c678-49f7-8858-426e75f520f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Volume 9b71e9b2-9d12-4143-b6dd-785279c6e7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1', 'volume_size': 1} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b71e9b2-9d12-4143-b6dd-785279c6e7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99cf49266b3419e809bc3992516576b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:59Z,use_quota=True,user_id='7b6db7d0d886460aab30860ae723b905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Creating volume 9b71e9b2-9d12-4143-b6dd-785279c6e7c1 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:59 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:59 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 1073741824 Nov 02 10:54:59 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-34147c2c-a173-48a3-b94a-191b190090cd tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created volume successfully. Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:59 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:54:59 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:59 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.290s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleted volume successfully. Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ef27eaeb-bfb9-40a0-8f7a-65739281fc57 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-2bdb77ce-20cc-4938-b3e5-4eb50acfac87-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:59 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 1073741824" returned: 0 in 0.513s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:59 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 Nov 02 10:54:59 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-71c44b01-133d-4e03-908a-a07ae987b8d0-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:00 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1" returned: 0 in 0.366s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-71c44b01-133d-4e03-908a-a07ae987b8d0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656125f0-c678-49f7-8858-426e75f520f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bd4f5c-665b-41f9-b9e0-3cda85095e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:00 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Volume volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 (9b71e9b2-9d12-4143-b6dd-785279c6e7c1): created successfully Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bd4f5c-665b-41f9-b9e0-3cda85095e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Flow 'volume_create_manager' (b15ae94a-5136-40da-b97b-a93fcf72d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dda87fa1-ca23-486a-8ccb-a68e179cb01f tempest-CinderUnicodeTest-2039840283 None] Created volume successfully. Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-71c44b01-133d-4e03-908a-a07ae987b8d0" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-71c44b01-133d-4e03-908a-a07ae987b8d0" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1961915e-435f-48ff-9e9c-c78dd86301f5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (6ad9213b-4658-4c83-920a-10651217e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4723df-0d96-4925-b26a-24b52ab91549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:00 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 Nov 02 10:55:00 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4723df-0d96-4925-b26a-24b52ab91549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-78644191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eda277c-64bd-4205-8b29-69e89f334304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:00Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8f813e-157c-41ae-af31-02998966fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8f813e-157c-41ae-af31-02998966fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a235d9-92b6-43dd-854a-346963f29942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a235d9-92b6-43dd-854a-346963f29942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eda277c-64bd-4205-8b29-69e89f334304', 'volume_name': 'volume-2eda277c-64bd-4205-8b29-69e89f334304', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee48f355-82b4-4d4a-bf66-f73e53baac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee48f355-82b4-4d4a-bf66-f73e53baac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b9ed76-addf-4f25-9d9b-d0d51d92d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:00 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 1073741824 Nov 02 10:55:00 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume 2eda277c-64bd-4205-8b29-69e89f334304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eda277c-64bd-4205-8b29-69e89f334304', 'volume_size': 1} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-78644191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eda277c-64bd-4205-8b29-69e89f334304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:00Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Creating volume 2eda277c-64bd-4205-8b29-69e89f334304 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:00 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:00 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:00 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0" returned: 0 in 0.542s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:00 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0 Nov 02 10:55:00 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (b101fef4-6180-4f66-8409-16596c78d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069294c1-cee6-4e67-b0c9-e10f7bf78980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069294c1-cee6-4e67-b0c9-e10f7bf78980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801756812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6062cb49-20a8-4bf8-aba4-183086e77862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:01Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2040382-dcc0-40d1-8a30-dc23d6e3a1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2040382-dcc0-40d1-8a30-dc23d6e3a1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a5642-349a-405e-83d2-318fe347f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a5642-349a-405e-83d2-318fe347f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6062cb49-20a8-4bf8-aba4-183086e77862', 'volume_name': 'volume-6062cb49-20a8-4bf8-aba4-183086e77862', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bd1ce5-fa1d-4632-94ca-c68c5c364e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bd1ce5-fa1d-4632-94ca-c68c5c364e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6bcee9-cfc5-4f21-9e69-77f4954451e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume 6062cb49-20a8-4bf8-aba4-183086e77862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6062cb49-20a8-4bf8-aba4-183086e77862', 'volume_size': 1} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:01 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-71c44b01-133d-4e03-908a-a07ae987b8d0" returned: 0 in 0.517s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-71c44b01-133d-4e03-908a-a07ae987b8d0" released by "delete_volume" :: held 1.132s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:01 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 1073741824" returned: 0 in 0.911s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['0c9a2bab-de97-4dab-afe4-47dcc871a96f', 'a2b0056e-0892-44fb-95b8-f331b10201dc', '9d28340e-4db5-4714-bca0-db3dbc463e8c', '56f2e740-d40b-4c83-956a-268a2f12f9a1'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (85fa2106-323a-4454-a2a7-c67d0294fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63009058-ef5e-4c79-b63b-d0de92527986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:01 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 Nov 02 10:55:01 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63009058-ef5e-4c79-b63b-d0de92527986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574615133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2820a537-b512-4a23-97f0-75ee1a4cf79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:01Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3cdcba-a599-4fc5-a904-3197495d0a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3cdcba-a599-4fc5-a904-3197495d0a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c83b8cf-7e8f-41ed-9fdf-36ef081b02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c83b8cf-7e8f-41ed-9fdf-36ef081b02cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2820a537-b512-4a23-97f0-75ee1a4cf79b', 'volume_name': 'volume-2820a537-b512-4a23-97f0-75ee1a4cf79b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7399b9-1fdb-44cb-8460-0ce5d259c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7399b9-1fdb-44cb-8460-0ce5d259c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f9c85e-ded9-4ef5-9ad0-3d4f1d86030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume 2820a537-b512-4a23-97f0-75ee1a4cf79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2820a537-b512-4a23-97f0-75ee1a4cf79b', 'volume_size': 1} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:01 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:01 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:02 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304" returned: 0 in 0.475s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801756812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6062cb49-20a8-4bf8-aba4-183086e77862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:01Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Creating volume 6062cb49-20a8-4bf8-aba4-183086e77862 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:02 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:02 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 1073741824 Nov 02 10:55:02 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b9ed76-addf-4f25-9d9b-d0d51d92d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eda277c-64bd-4205-8b29-69e89f334304', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1841516-84c9-4342-a9fb-17c133fb1aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.419s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleted volume successfully. Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume volume-2eda277c-64bd-4205-8b29-69e89f334304 (2eda277c-64bd-4205-8b29-69e89f334304): created successfully Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1841516-84c9-4342-a9fb-17c133fb1aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (6ad9213b-4658-4c83-920a-10651217e246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (0e0f5943-3ca1-42ef-a5b0-229cd371834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f56f746-4499-4c33-85f1-8a4aee2f79f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f56f746-4499-4c33-85f1-8a4aee2f79f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673714069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599c88d2-6272-4f55-a357-2fd66819a26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:02Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459d831f-c832-472a-b61c-103c8b512f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459d831f-c832-472a-b61c-103c8b512f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0fc838-4127-4951-b99d-a6bd12393fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0fc838-4127-4951-b99d-a6bd12393fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599c88d2-6272-4f55-a357-2fd66819a26b', 'volume_name': 'volume-599c88d2-6272-4f55-a357-2fd66819a26b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25f890e-36d0-40e2-930d-84efa352c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25f890e-36d0-40e2-930d-84efa352c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0139e340-adb6-43e8-83a2-e05a91c0d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume 599c88d2-6272-4f55-a357-2fd66819a26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599c88d2-6272-4f55-a357-2fd66819a26b', 'volume_size': 1} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-acc8b53d-af77-4e15-9c16-b71cc274c0d1 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-71c44b01-133d-4e03-908a-a07ae987b8d0-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-67e12269-b892-4e19-930a-9595ede72a1b tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created volume successfully. Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Flow 'volume_create_manager' (04896d41-b56d-49a3-8fec-6a2d9c6329aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7080371b-581c-4ed4-b8ee-b78e59fe2de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7080371b-581c-4ed4-b8ee-b78e59fe2de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-93286032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e94c3c-7e70-4b0f-831d-5380d4eec4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99cf49266b3419e809bc3992516576b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:02Z,use_quota=True,user_id='7b6db7d0d886460aab30860ae723b905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347e0106-8196-4412-b354-b6937b4fd3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347e0106-8196-4412-b354-b6937b4fd3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecfe4dc-1555-4636-944d-d9448ee9d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecfe4dc-1555-4636-944d-d9448ee9d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e94c3c-7e70-4b0f-831d-5380d4eec4c5', 'volume_name': 'volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2816284-80ca-48b3-bc16-332e4a802678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2816284-80ca-48b3-bc16-332e4a802678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed72106-0fcc-40af-9c5d-54b9ad7ffb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Volume 04e94c3c-7e70-4b0f-831d-5380d4eec4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5', 'volume_size': 1} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-7a7df45e-b9e1-4826-8bb6-820fb3870374-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-7a7df45e-b9e1-4826-8bb6-820fb3870374-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-7a7df45e-b9e1-4826-8bb6-820fb3870374" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-7a7df45e-b9e1-4826-8bb6-820fb3870374" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a502537e-1a2d-4f19-a9c1-eb00daeefa32]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:02 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 1073741824" returned: 0 in 0.720s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:02 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 Nov 02 10:55:02 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (d55f88cd-f700-4789-b4a2-51658113c1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60aca75-808c-4076-9ddc-5d052c0aee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 Nov 02 10:55:02 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60aca75-808c-4076-9ddc-5d052c0aee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1743903543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f92a96-a5f6-4232-872b-83203748182e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:03Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed677e-bd2e-4243-9239-c44a17eab561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed677e-bd2e-4243-9239-c44a17eab561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acda8426-74a2-4edd-be90-06fadcca4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acda8426-74a2-4edd-be90-06fadcca4c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f92a96-a5f6-4232-872b-83203748182e', 'volume_name': 'volume-a6f92a96-a5f6-4232-872b-83203748182e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2969ea6f-6cdc-40a0-be37-f59b738b4481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2969ea6f-6cdc-40a0-be37-f59b738b4481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187bd101-ae61-424a-9c4a-c17c281e40fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume a6f92a96-a5f6-4232-872b-83203748182e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f92a96-a5f6-4232-872b-83203748182e', 'volume_size': 1} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Flow 'volume_create_manager' (badc2f46-af01-40be-bae8-b2e9b424ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a263ba-2c33-4a57-962f-1e890797ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a263ba-2c33-4a57-962f-1e890797ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-573726336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d12e93f-7d65-42e8-9cf8-5cc79df006f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf877c4ca7854611b29088c1503b1541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:03Z,use_quota=True,user_id='3f083d329ca547e885aa4198aa3109de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10611917-4bf4-40f4-b8a9-e78e01d6e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10611917-4bf4-40f4-b8a9-e78e01d6e166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3669c8d-52bc-4d05-b3ef-29d427e33a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3669c8d-52bc-4d05-b3ef-29d427e33a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d12e93f-7d65-42e8-9cf8-5cc79df006f5', 'volume_name': 'volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdc1372-98c9-445e-a2f2-11595abaf8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdc1372-98c9-445e-a2f2-11595abaf8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8163236-ca30-4d3b-b2a3-56da3420b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Volume 1d12e93f-7d65-42e8-9cf8-5cc79df006f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5', 'volume_size': 1} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:03 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862" returned: 0 in 0.316s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574615133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2820a537-b512-4a23-97f0-75ee1a4cf79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:01Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Creating volume 2820a537-b512-4a23-97f0-75ee1a4cf79b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:03 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6bcee9-cfc5-4f21-9e69-77f4954451e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6062cb49-20a8-4bf8-aba4-183086e77862', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b 1073741824 Nov 02 10:55:03 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a165f6-748e-4211-852a-a72909f8a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374" returned: 0 in 0.420s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:03 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume volume-6062cb49-20a8-4bf8-aba4-183086e77862 (6062cb49-20a8-4bf8-aba4-183086e77862): created successfully Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a165f6-748e-4211-852a-a72909f8a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374 Nov 02 10:55:03 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (b101fef4-6180-4f66-8409-16596c78d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-65a54d56-97a1-4bf9-bea3-81041f1dd49d tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created volume successfully. Nov 02 10:55:03 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a7df45e-b9e1-4826-8bb6-820fb3870374" returned: 0 in 0.253s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-7a7df45e-b9e1-4826-8bb6-820fb3870374" released by "delete_volume" :: held 0.719s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['638b7168-a5e7-4e7c-be69-15a4ad016977', '21d141ff-448e-4b18-8c4e-2d71771b93ac', 'f1e34b0a-11d2-40b2-88d9-8e7acaad060a', 'be6408c4-682f-4cb9-aea8-cdae386ecf84'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:03 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:03 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:03 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b 1073741824" returned: 0 in 0.495s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:03 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b Nov 02 10:55:03 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-13efc182-d68b-4b26-8f3b-6407c788bcb7-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-13efc182-d68b-4b26-8f3b-6407c788bcb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-18886267-ef4a-4aeb-baed-a144ee0f8be8" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-18886267-ef4a-4aeb-baed-a144ee0f8be8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-13efc182-d68b-4b26-8f3b-6407c788bcb7" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:03 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-13efc182-d68b-4b26-8f3b-6407c788bcb7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleting offline snapshot 13efc182-d68b-4b26-8f3b-6407c788bcb7 of volume 18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] snapshot_file for this snap is: volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleted volume successfully. Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6591a6fc-20ae-46de-8855-95a71b28bcb5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0efbb5cd-6d01-44ad-8706-274dddcb6d1f tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-7a7df45e-b9e1-4826-8bb6-820fb3870374-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:04 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673714069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599c88d2-6272-4f55-a357-2fd66819a26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:02Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Creating volume 599c88d2-6272-4f55-a357-2fd66819a26b {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f9c85e-ded9-4ef5-9ad0-3d4f1d86030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2820a537-b512-4a23-97f0-75ee1a4cf79b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b 1073741824 Nov 02 10:55:04 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 Nov 02 10:55:04 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bce3cb-f3ee-4b87-bb17-cb53ce1d0e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume volume-2820a537-b512-4a23-97f0-75ee1a4cf79b (2820a537-b512-4a23-97f0-75ee1a4cf79b): created successfully Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bce3cb-f3ee-4b87-bb17-cb53ce1d0e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (85fa2106-323a-4454-a2a7-c67d0294fb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1bbfc7bb-f147-4cfa-af59-7cc1078203cf tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created volume successfully. Nov 02 10:55:04 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7" returned: 0 in 0.371s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18886267-ef4a-4aeb-baed-a144ee0f8be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f15ac3-db2e-4f02-b683-563001341d0d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b 1073741824" returned: 0 in 0.435s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 Nov 02 10:55:04 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b Nov 02 10:55:04 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8" returned: 0 in 0.386s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b" returned: 0 in 0.256s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.195s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-93286032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e94c3c-7e70-4b0f-831d-5380d4eec4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99cf49266b3419e809bc3992516576b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:02Z,use_quota=True,user_id='7b6db7d0d886460aab30860ae723b905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Creating volume 04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:04 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 Nov 02 10:55:04 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 1073741824 Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0139e340-adb6-43e8-83a2-e05a91c0d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599c88d2-6272-4f55-a357-2fd66819a26b', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9351d5e-d147-4252-823b-da50121ff617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume volume-599c88d2-6272-4f55-a357-2fd66819a26b (599c88d2-6272-4f55-a357-2fd66819a26b): created successfully Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9351d5e-d147-4252-823b-da50121ff617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (0e0f5943-3ca1-42ef-a5b0-229cd371834a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:04 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f868488a-d6d2-43ff-883d-20af90ea7a64 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created volume successfully. Nov 02 10:55:05 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7" returned: 0 in 0.389s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:05 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7 Nov 02 10:55:05 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:05 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 1073741824" returned: 0 in 0.479s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:05 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 Nov 02 10:55:05 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:05 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8.13efc182-d68b-4b26-8f3b-6407c788bcb7" returned: 0 in 0.257s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-13efc182-d68b-4b26-8f3b-6407c788bcb7" released by "_delete_snapshot" :: held 1.525s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-18886267-ef4a-4aeb-baed-a144ee0f8be8" released by "delete_snapshot" :: held 1.549s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['3ea63ba7-1fbc-4d83-9c52-360d95e4c585', 'ed765a4f-5cac-41a9-89aa-cb8d69ef8c35', '828e796e-0f14-4d95-afdd-c281c411b5f4', '82725224-4ac0-43dc-8fd1-b52d5349ad0d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Delete snapshot completed successfully. Nov 02 10:55:05 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" returned: 0 in 0.250s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e24d713b-1342-41d2-acbe-4bd948be0fc5 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-13efc182-d68b-4b26-8f3b-6407c788bcb7-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1743903543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f92a96-a5f6-4232-872b-83203748182e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64002f75313459ebaf18e9939ec623b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:03Z,use_quota=True,user_id='97e4f17e1cae4a97a9cb746d49eeea95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Creating volume a6f92a96-a5f6-4232-872b-83203748182e {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:05 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:05 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e 1073741824 Nov 02 10:55:05 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed72106-0fcc-40af-9c5d-54b9ad7ffb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca1b6ee-7add-48db-855a-d3a636edd334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Volume volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 (04e94c3c-7e70-4b0f-831d-5380d4eec4c5): created successfully Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca1b6ee-7add-48db-855a-d3a636edd334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Flow 'volume_create_manager' (04896d41-b56d-49a3-8fec-6a2d9c6329aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-07b80edc-b291-4f66-9e3a-5fca066fa74f tempest-CinderUnicodeTest-2039840283 None] Created volume successfully. Nov 02 10:55:05 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e 1073741824" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-18886267-ef4a-4aeb-baed-a144ee0f8be8-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-18886267-ef4a-4aeb-baed-a144ee0f8be8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:06 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e Nov 02 10:55:06 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "cinder-quobyte-18886267-ef4a-4aeb-baed-a144ee0f8be8" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-18886267-ef4a-4aeb-baed-a144ee0f8be8" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a54d3d-deba-4139-8bca-f894ddf43ed3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:06 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 Nov 02 10:55:06 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:06 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-573726336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d12e93f-7d65-42e8-9cf8-5cc79df006f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf877c4ca7854611b29088c1503b1541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:03Z,use_quota=True,user_id='3f083d329ca547e885aa4198aa3109de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Creating volume 1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:06 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187bd101-ae61-424a-9c4a-c17c281e40fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f92a96-a5f6-4232-872b-83203748182e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12c0643-1b8a-496c-a31a-1754b338825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:06 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 1073741824 Nov 02 10:55:06 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:06 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Volume volume-a6f92a96-a5f6-4232-872b-83203748182e (a6f92a96-a5f6-4232-872b-83203748182e): created successfully Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12c0643-1b8a-496c-a31a-1754b338825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Flow 'volume_create_manager' (d55f88cd-f700-4789-b4a2-51658113c1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-555297fa-a165-478b-9456-22aa76b136d1 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created volume successfully. Nov 02 10:55:06 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:06 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8 Nov 02 10:55:06 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:06 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-18886267-ef4a-4aeb-baed-a144ee0f8be8" returned: 0 in 0.255s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-quobyte-18886267-ef4a-4aeb-baed-a144ee0f8be8" released by "delete_volume" :: held 0.674s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Created reservations ['c8d780e2-62f2-4fe6-99dd-63cf5ee00f7c', 'ef35d2f5-8b23-472a-b54d-e284c427b69a', '8129ee4f-b130-4c8d-9c83-844e6c42197c', '4d35e405-e40e-48e2-971d-8cdd01ebba01'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:06 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 1073741824" returned: 0 in 0.513s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:06 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 Nov 02 10:55:06 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:07 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:07 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" returned: 0 in 0.328s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.081s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8163236-ca30-4d3b-b2a3-56da3420b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c076a84-6fcf-415c-86aa-54e9b7388e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-a6f92a96-a5f6-4232-872b-83203748182e-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Creating offline snapshot 45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 of volume 04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:07 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Volume volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 (1d12e93f-7d65-42e8-9cf8-5cc79df006f5): created successfully Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c076a84-6fcf-415c-86aa-54e9b7388e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Flow 'volume_create_manager' (badc2f46-af01-40be-bae8-b2e9b424ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-a6f92a96-a5f6-4232-872b-83203748182e-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaa1d94-4e8c-4f64-b7d3-d10300855c05]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-27153d7a-50fa-4180-bf75-da0e89112488 tempest-VolumeDependencyTests-1111044037 None] Created volume successfully. Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.428s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Deleted volume successfully. Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-quobyte-a6f92a96-a5f6-4232-872b-83203748182e" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-61d86d60-0574-4c31-bfad-58a582081576 tempest-CreateVolumesFromSnapshotTest-1473881793 None] Lock "cinder-18886267-ef4a-4aeb-baed-a144ee0f8be8-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-a6f92a96-a5f6-4232-872b-83203748182e" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0e5b0e-ede1-4497-a789-c3fc9b120121]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:07 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:07 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e Nov 02 10:55:07 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:07 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" returned: 0 in 0.454s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 1G Nov 02 10:55:07 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:07 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e" returned: 0 in 0.402s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e Nov 02 10:55:07 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:08 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a6f92a96-a5f6-4232-872b-83203748182e" returned: 0 in 0.380s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-a6f92a96-a5f6-4232-872b-83203748182e" released by "delete_volume" :: held 0.833s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:08 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 1G" returned: 0 in 0.552s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:08 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 Nov 02 10:55:08 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created reservations ['0f61af96-863d-407f-87b6-5ee6de444abc', '32d89c66-db1b-452b-b4d1-ade78e47d729', '71a56a82-bbb8-49cd-9392-2664f920421f', '7f91bd48-3891-4e53-9c0b-b0f59a477647'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:08 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:08 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:08 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" returned: 0 in 0.313s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:08 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 is being set with open permissions: ugo+rw Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:08 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 Nov 02 10:55:08 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:08 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Deleted volume successfully. Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3c4a3324-0ce2-45d8-a01e-556e9f9fde02 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-a6f92a96-a5f6-4232-872b-83203748182e-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:08 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info Nov 02 10:55:09 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:09 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info" returned: 0 in 0.294s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:09 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info is being set with open permissions: ugo+rw Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info Nov 02 10:55:09 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-599c88d2-6272-4f55-a357-2fd66819a26b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-599c88d2-6272-4f55-a357-2fd66819a26b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:09 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.info" returned: 0 in 0.290s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.302s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-quobyte-599c88d2-6272-4f55-a357-2fd66819a26b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Creating offline snapshot d26c6009-93a2-4036-aae8-5166f3670e16 of volume 1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-599c88d2-6272-4f55-a357-2fd66819a26b" acquired by "delete_volume" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[33732c37-4010-40d8-b6d6-64033412c6f9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-33d3dad0-381b-40ff-bff3-5a995a672bb1 tempest-CinderUnicodeTest-2039840283 None] Create snapshot completed successfully Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[10234d2e-5d4a-4262-bdbf-bdd5d888399f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 Nov 02 10:55:09 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:09 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b Nov 02 10:55:09 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" returned: 0 in 0.409s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 1G Nov 02 10:55:10 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b" returned: 0 in 0.431s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b Nov 02 10:55:10 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-45bd10d6-b6ef-4a49-b7b4-3d37eaa40462-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-45bd10d6-b6ef-4a49-b7b4-3d37eaa40462-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-quobyte-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-quobyte-45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Deleting offline snapshot 45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 of volume 04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] snapshot_file for this snap is: volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ad184c-7853-4f98-a97a-ddd90cc58706]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:10 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-599c88d2-6272-4f55-a357-2fd66819a26b" returned: 0 in 0.318s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-599c88d2-6272-4f55-a357-2fd66819a26b" released by "delete_volume" :: held 0.810s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created reservations ['f261bdc3-65d5-4339-818c-c8951e69bd11', 'b60060ff-5b2e-40bf-8efd-a0639701e0c4', '9fa22f6f-3111-41b5-b450-5e4d07c41d05', '1b03e783-e4a0-4f2a-b072-7bd106593969'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:10 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 Nov 02 10:55:10 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 1G" returned: 0 in 0.552s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 Nov 02 10:55:10 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:10 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-2820a537-b512-4a23-97f0-75ee1a4cf79b-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-2820a537-b512-4a23-97f0-75ee1a4cf79b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-quobyte-2820a537-b512-4a23-97f0-75ee1a4cf79b" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-2820a537-b512-4a23-97f0-75ee1a4cf79b" acquired by "delete_volume" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f22257-6fa8-4418-9977-3298f2e11904]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" returned: 0 in 0.583s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.378s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Deleted volume successfully. Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad4d9e6-ad08-4c03-9fb2-52d0ce47b66a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b Nov 02 10:55:11 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a4a1696b-8b6a-4a5a-bf5f-0fc3903bb507 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-599c88d2-6272-4f55-a357-2fd66819a26b-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:11 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16" returned: 0 in 0.471s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 is being set with open permissions: ugo+rw Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 Nov 02 10:55:11 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 Nov 02 10:55:11 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b" returned: 0 in 0.536s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b Nov 02 10:55:11 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info Nov 02 10:55:11 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" returned: 0 in 0.514s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 Nov 02 10:55:11 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (d3e15eea-f8cf-496c-ada6-32f08a873c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889b444c-4abe-48de-bf1a-4d786722e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889b444c-4abe-48de-bf1a-4d786722e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716128901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6c244e-23f5-476f-b1a8-b0646e501466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:12Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e47016-cc4f-429a-89d9-d447b8e5e9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e47016-cc4f-429a-89d9-d447b8e5e9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93ab8f9-bccc-4ef5-8882-8764f89c49ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93ab8f9-bccc-4ef5-8882-8764f89c49ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6c244e-23f5-476f-b1a8-b0646e501466', 'volume_name': 'volume-cc6c244e-23f5-476f-b1a8-b0646e501466', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904ce241-99e3-433d-b39a-c5dcb342dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904ce241-99e3-433d-b39a-c5dcb342dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23c6444-b7ff-4ff2-8455-c67d15f7e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:11 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Volume cc6c244e-23f5-476f-b1a8-b0646e501466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6c244e-23f5-476f-b1a8-b0646e501466', 'volume_size': 1} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:11 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2820a537-b512-4a23-97f0-75ee1a4cf79b" returned: 0 in 0.284s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-2820a537-b512-4a23-97f0-75ee1a4cf79b" released by "delete_volume" :: held 0.874s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created reservations ['dbf2137b-9530-4613-9071-faded81471e9', 'ec94d585-083e-4db3-a3f0-348256200069', 'c8bb8c5b-f4a3-4437-a1ad-5ad94a924b5d', '9cd5c6a2-23bf-4370-ae58-9c3ecd956676'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:11 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info" returned: 0 in 0.314s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info is being set with open permissions: ugo+rw Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info Nov 02 10:55:11 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:11 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:12 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" returned: 0 in 0.437s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:12 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462 Nov 02 10:55:12 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:12 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.info" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716128901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6c244e-23f5-476f-b1a8-b0646e501466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:12Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Creating volume cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:12 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:12 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-6062cb49-20a8-4bf8-aba4-183086e77862-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:12 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 1073741824 Nov 02 10:55:12 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.323s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Deleted volume successfully. Nov 02 10:55:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-48868fa1-d7c7-4db0-9e10-b2a85828b202 tempest-VolumeDependencyTests-1111044037 None] Create snapshot completed successfully Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-6062cb49-20a8-4bf8-aba4-183086e77862-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-febefd99-25fd-47b0-abee-c68c37486f61 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-2820a537-b512-4a23-97f0-75ee1a4cf79b-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-quobyte-6062cb49-20a8-4bf8-aba4-183086e77862" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-6062cb49-20a8-4bf8-aba4-183086e77862" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6083fa9b-b651-40cd-9f1a-556000edabe9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:12 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5.45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-45bd10d6-b6ef-4a49-b7b4-3d37eaa40462" released by "_delete_snapshot" :: held 2.064s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" released by "delete_snapshot" :: held 2.099s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:12 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 Nov 02 10:55:12 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Created reservations ['0c9bc120-729f-4bed-8910-66e9e0776e27', '96146e99-ec00-4ad6-8b75-f8c8fdef1be6', 'ea31b4e5-be06-454f-8f7d-7d0ec94de163', 'e5d50e43-60a9-468d-85fb-6938032d0367'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Delete snapshot completed successfully. Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eee99107-6c0c-4a8e-97ae-77032f903468 tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-45bd10d6-b6ef-4a49-b7b4-3d37eaa40462-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:12 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862" returned: 0 in 0.435s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:12 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862 Nov 02 10:55:12 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:12 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 1073741824" returned: 0 in 0.666s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:12 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 Nov 02 10:55:12 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:13 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-6062cb49-20a8-4bf8-aba4-183086e77862" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-6062cb49-20a8-4bf8-aba4-183086e77862" released by "delete_volume" :: held 0.760s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Flow 'volume_create_manager' (1a2ed722-12e2-4d9a-923a-fe9af8a730ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9044d7-2b2b-49d8-ae0d-9fb85ff353a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9044d7-2b2b-49d8-ae0d-9fb85ff353a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-119494778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfbb685-941d-4465-a475-a6f84dd8db95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf877c4ca7854611b29088c1503b1541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d26c6009-93a2-4036-aae8-5166f3670e16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:13Z,use_quota=True,user_id='3f083d329ca547e885aa4198aa3109de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:13 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e06c34-c19e-4cac-8359-6d517526f934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e06c34-c19e-4cac-8359-6d517526f934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c387e066-5986-4b88-b045-1ffe2bffa94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c387e066-5986-4b88-b045-1ffe2bffa94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fdfbb685-941d-4465-a475-a6f84dd8db95', 'volume_name': 'volume-fdfbb685-941d-4465-a475-a6f84dd8db95', 'volume_size': 1, 'snapshot_id': 'd26c6009-93a2-4036-aae8-5166f3670e16'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c20dd32-71e6-4f64-af0f-9ba5e3433ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c20dd32-71e6-4f64-af0f-9ba5e3433ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497200ce-aa6d-45f0-b80e-4dee8f18fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:13 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Volume fdfbb685-941d-4465-a475-a6f84dd8db95: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fdfbb685-941d-4465-a475-a6f84dd8db95', 'volume_size': 1, 'snapshot_id': 'd26c6009-93a2-4036-aae8-5166f3670e16'} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466" returned: 0 in 0.337s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-quobyte-d26c6009-93a2-4036-aae8-5166f3670e16-fdfbb685-941d-4465-a475-a6f84dd8db95" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23c6444-b7ff-4ff2-8455-c67d15f7e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6c244e-23f5-476f-b1a8-b0646e501466', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e2af13-4003-497f-a56b-f12676331240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created reservations ['4cbffd22-2f79-42df-9cf5-fd22c01fd06e', '09fe56ee-1cc8-4496-81ba-e4414c9ccb78', 'b3abf020-07e6-45e1-a54b-1b79ebfe42f9', 'cb97b17d-a5f2-46a2-bf74-77a68f5aaca0'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:13 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Volume volume-cc6c244e-23f5-476f-b1a8-b0646e501466 (cc6c244e-23f5-476f-b1a8-b0646e501466): created successfully Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e2af13-4003-497f-a56b-f12676331240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (d3e15eea-f8cf-496c-ada6-32f08a873c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-d26c6009-93a2-4036-aae8-5166f3670e16-fdfbb685-941d-4465-a475-a6f84dd8db95" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Creating volume fdfbb685-941d-4465-a475-a6f84dd8db95 from snapshot d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-quobyte-fdfbb685-941d-4465-a475-a6f84dd8db95" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d750f807-eb27-4a33-9839-f83c4eff9ced tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-fdfbb685-941d-4465-a475-a6f84dd8db95" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] snapshot: d26c6009-93a2-4036-aae8-5166f3670e16, volume: fdfbb685-941d-4465-a475-a6f84dd8db95, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493ef31-b31d-4666-9764-23678acb5282]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-2eda277c-64bd-4205-8b29-69e89f334304-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:13 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:13 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-2eda277c-64bd-4205-8b29-69e89f334304-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-quobyte-2eda277c-64bd-4205-8b29-69e89f334304" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-2eda277c-64bd-4205-8b29-69e89f334304" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 Nov 02 10:55:13 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d9cb0-23c6-4d92-b090-bbd9ace5b0af]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-04e94c3c-7e70-4b0f-831d-5380d4eec4c5-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-04e94c3c-7e70-4b0f-831d-5380d4eec4c5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-quobyte-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Deleted volume successfully. Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 Nov 02 10:55:13 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-22d4a87e-f783-473e-b22c-64abff275fa9 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-6062cb49-20a8-4bf8-aba4-183086e77862-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf69415-ee1f-443d-94af-ccd9e460a8c9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:13 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 Nov 02 10:55:13 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:13 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16" returned: 0 in 0.563s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fd0a51-54dc-43c9-a4c3-1ff6e890f20a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304" returned: 0 in 0.560s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 Nov 02 10:55:14 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:14 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304 Nov 02 10:55:14 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:14 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" returned: 0 in 0.483s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5 Nov 02 10:55:14 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:14 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2eda277c-64bd-4205-8b29-69e89f334304" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-2eda277c-64bd-4205-8b29-69e89f334304" released by "delete_volume" :: held 0.915s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:14 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" returned: 0 in 0.472s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 Nov 02 10:55:14 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created reservations ['5a3f35f8-9fb2-42ff-8f97-b1b811dbb2b2', '439b287f-d8f6-4d53-86cd-83cf66d1bb7e', 'b4653013-21f2-4243-9998-e96c9b10cb5f', 'cb8c0db5-3f61-464d-9a70-cfebba47591a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:14 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" returned: 0 in 0.288s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-04e94c3c-7e70-4b0f-831d-5380d4eec4c5" released by "delete_volume" :: held 0.875s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:14 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:14 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-7a830259-d678-48c4-81cc-48c0ffddf1be-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-7a830259-d678-48c4-81cc-48c0ffddf1be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "cinder-quobyte-7a830259-d678-48c4-81cc-48c0ffddf1be" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Created reservations ['307178cd-3101-47e2-9555-f53198c41c04', '52aa4378-4151-473b-ae96-0dcd056f2097', 'a2818ef2-2a84-4fd3-a24d-1d794e4b750b', 'f9be3162-34dc-41b4-b22d-27fa58ae6c7a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-7a830259-d678-48c4-81cc-48c0ffddf1be" acquired by "delete_volume" :: waited 0.052s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c12cb-76ea-48df-98bf-ff92cf33dce7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:14 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:15 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be Nov 02 10:55:15 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:15 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.388s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Deleted volume successfully. Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3d51aefd-b750-4999-b6d8-b2412d4d265a tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-2eda277c-64bd-4205-8b29-69e89f334304-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:15 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.474s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Deleted volume successfully. Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4c729108-026a-4cb9-85ca-fb09b4ca3e2f tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-04e94c3c-7e70-4b0f-831d-5380d4eec4c5-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:15 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be" returned: 0 in 0.636s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:15 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be Nov 02 10:55:15 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-9b71e9b2-9d12-4143-b6dd-785279c6e7c1-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:16 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7a830259-d678-48c4-81cc-48c0ffddf1be" returned: 0 in 0.537s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-9b71e9b2-9d12-4143-b6dd-785279c6e7c1-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-quobyte-7a830259-d678-48c4-81cc-48c0ffddf1be" released by "delete_volume" :: held 1.264s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "cinder-quobyte-9b71e9b2-9d12-4143-b6dd-785279c6e7c1" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-9b71e9b2-9d12-4143-b6dd-785279c6e7c1" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Created reservations ['54be0331-e0fc-43b2-9263-24f4a1a313d9', '457a9cee-bda7-4b46-ac8e-6d04ff4e262c', '544008fa-2a02-46a0-8dc0-2fcf3c8868fd', 'd3a1c0c2-2f41-44a1-bd80-8f0730949f8c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e99cad8-d6d3-4c95-a71d-610ffac291af]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:16 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 Nov 02 10:55:16 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:16 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:16 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:16 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.376s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:16 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1" returned: 0 in 0.581s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Deleted volume successfully. Nov 02 10:55:16 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1 Nov 02 10:55:16 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-c3bc2648-4250-4720-8517-0a5ca0223ac2 tempest-CreateVolumesFromSourceVolumeTest-106898279 None] Lock "cinder-7a830259-d678-48c4-81cc-48c0ffddf1be-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:17 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-9b71e9b2-9d12-4143-b6dd-785279c6e7c1" returned: 0 in 0.418s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-quobyte-9b71e9b2-9d12-4143-b6dd-785279c6e7c1" released by "delete_volume" :: held 1.081s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Created reservations ['56f0783c-45ed-4595-9e72-d4dc24e8eba2', '37f980f9-8c14-4cdf-a55d-1d4ac6d385ea', 'fd1fe953-c8df-4749-bf24-d7b81d574097', '60d377b2-4e6e-43b0-b7ad-1d11a82a60a4'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:17 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:17 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:18 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.436s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:18 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:18 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Deleted volume successfully. Nov 02 10:55:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-fa77fd7a-bf55-43ed-924c-d4694a5b33bb tempest-CinderUnicodeTest-2039840283 None] Lock "cinder-9b71e9b2-9d12-4143-b6dd-785279c6e7c1-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:22 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95" returned: 0 in 8.061s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:55:22 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Converted 1024.00 MB image at 127.02 MB/s Nov 02 10:55:22 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 is being set with open permissions: ugo+rw Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 Nov 02 10:55:22 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:22 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-fdfbb685-941d-4465-a475-a6f84dd8db95" released by "_copy_volume_from_snapshot" :: held 9.498s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-d26c6009-93a2-4036-aae8-5166f3670e16-fdfbb685-941d-4465-a475-a6f84dd8db95" released by "_create_volume_from_snapshot" :: held 9.591s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.636s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.694s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Creating offline snapshot 079c8258-6a78-404e-8747-4b1fb3a4ebf6 of volume cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:22 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497200ce-aa6d-45f0-b80e-4dee8f18fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdfbb685-941d-4465-a475-a6f84dd8db95', 'volume_size': 1, 'snapshot_id': 'd26c6009-93a2-4036-aae8-5166f3670e16'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f8aee5-46e5-4443-85c1-0deb336adbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2d413-2dda-4ec2-9762-6384fb4c7824]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.391s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:55:23 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Volume volume-fdfbb685-941d-4465-a475-a6f84dd8db95 (fdfbb685-941d-4465-a475-a6f84dd8db95): created successfully Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f8aee5-46e5-4443-85c1-0deb336adbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Flow 'volume_create_manager' (1a2ed722-12e2-4d9a-923a-fe9af8a730ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:23 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9e525d0e-d9cb-4d6b-9872-4b5feac3a08f tempest-VolumeDependencyTests-1111044037 None] Created volume successfully. Nov 02 10:55:23 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 Nov 02 10:55:23 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-d26c6009-93a2-4036-aae8-5166f3670e16-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-d26c6009-93a2-4036-aae8-5166f3670e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-quobyte-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-quobyte-d26c6009-93a2-4036-aae8-5166f3670e16" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-d26c6009-93a2-4036-aae8-5166f3670e16" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Deleting offline snapshot d26c6009-93a2-4036-aae8-5166f3670e16 of volume 1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] snapshot_file for this snap is: volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed359afd-7222-4860-925f-a354f8b35e49]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466" returned: 0 in 0.453s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 1G Nov 02 10:55:23 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 Nov 02 10:55:23 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16" returned: 0 in 0.474s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f53d99-17f8-4cf1-9a85-3b5f72c49c92]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:23 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 1G" returned: 0 in 0.537s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6c244e-23f5-476f-b1a8-b0646e501466 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6c244e-23f5-476f-b1a8-b0646e501466 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 Nov 02 10:55:24 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 Nov 02 10:55:24 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (0e91c4eb-45a0-4198-ab86-894e2015eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dccf51-f13b-4153-b86a-43692e800924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-5801745f-36b7-4215-8f88-75b75550d4d4 tempest-ProjectAdminTests-185770271 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8625526428223, 'free_capacity_gb': 1773.8625526428223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86926) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dccf51-f13b-4153-b86a-43692e800924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17429989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693b5889-6406-4f71-908a-7de7c9354aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:24Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd6d1ab-6c7f-4eca-b303-fe45bb09c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd6d1ab-6c7f-4eca-b303-fe45bb09c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62af360-193e-4d6d-adc9-5aab549ef49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62af360-193e-4d6d-adc9-5aab549ef49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693b5889-6406-4f71-908a-7de7c9354aba', 'volume_name': 'volume-693b5889-6406-4f71-908a-7de7c9354aba', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314a44e7-0d4b-43cc-978a-8a29020d0254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314a44e7-0d4b-43cc-978a-8a29020d0254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04391cb-7e13-4914-911f-bf6eda30bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Volume 693b5889-6406-4f71-908a-7de7c9354aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693b5889-6406-4f71-908a-7de7c9354aba', 'volume_size': 1} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6c244e-23f5-476f-b1a8-b0646e501466 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6" returned: 0 in 0.465s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 is being set with open permissions: ugo+rw Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 Nov 02 10:55:24 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" returned: 0 in 0.652s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 Nov 02 10:55:24 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6" returned: 0 in 0.269s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info Nov 02 10:55:24 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16" returned: 0 in 0.383s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16 Nov 02 10:55:25 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info" returned: 0 in 0.307s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info is being set with open permissions: ugo+rw Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info Nov 02 10:55:25 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5.d26c6009-93a2-4036-aae8-5166f3670e16" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-d26c6009-93a2-4036-aae8-5166f3670e16" released by "_delete_snapshot" :: held 1.926s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" released by "delete_snapshot" :: held 1.954s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:25 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.info" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17429989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693b5889-6406-4f71-908a-7de7c9354aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:24Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Creating volume 693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:25 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba 1073741824 Nov 02 10:55:25 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Created reservations ['66d3126c-32b9-4379-9348-fbf20409188f', '46466925-edec-4896-8ad1-233eef0fd1fa', '2a222481-d1bd-4308-beb7-2e021270c08a', '5d296057-dfbb-4a76-8d2a-60a20ffc73c4'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bd98988f-02e7-400b-97ba-7cd570a77fae tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:55:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Delete snapshot completed successfully. Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-164a59e2-12ef-4a37-a378-a9c01925c4eb tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-d26c6009-93a2-4036-aae8-5166f3670e16-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:25 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba 1073741824" returned: 0 in 0.491s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba Nov 02 10:55:25 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-079c8258-6a78-404e-8747-4b1fb3a4ebf6-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Lock "cinder-079c8258-6a78-404e-8747-4b1fb3a4ebf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-cc6c244e-23f5-476f-b1a8-b0646e501466" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-cc6c244e-23f5-476f-b1a8-b0646e501466" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-079c8258-6a78-404e-8747-4b1fb3a4ebf6" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-079c8258-6a78-404e-8747-4b1fb3a4ebf6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot 079c8258-6a78-404e-8747-4b1fb3a4ebf6 of volume cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d3250-b264-491c-a791-ec48d5afc074]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 Nov 02 10:55:26 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba" returned: 0 in 0.337s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04391cb-7e13-4914-911f-bf6eda30bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693b5889-6406-4f71-908a-7de7c9354aba', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab28ac5-0822-4311-8402-34c59846b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:26 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Volume volume-693b5889-6406-4f71-908a-7de7c9354aba (693b5889-6406-4f71-908a-7de7c9354aba): created successfully Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab28ac5-0822-4311-8402-34c59846b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (0e91c4eb-45a0-4198-ab86-894e2015eaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:26 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-43c75ab7-3ede-42ad-99a1-de4c1b8d3c17 tempest-ProjectReaderTests-679075022 None] Created volume successfully. Nov 02 10:55:26 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6" returned: 0 in 0.412s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc6c244e-23f5-476f-b1a8-b0646e501466(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-1d12e93f-7d65-42e8-9cf8-5cc79df006f5-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc2453-c9fd-4c73-bedf-7a42534875c3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-1d12e93f-7d65-42e8-9cf8-5cc79df006f5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-quobyte-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 Nov 02 10:55:26 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eab5b5-2eec-4fa0-8530-bab70ad7f3d6]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 Nov 02 10:55:26 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466" returned: 0 in 0.422s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 Nov 02 10:55:27 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5 Nov 02 10:55:27 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6 Nov 02 10:55:27 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" returned: 0 in 0.320s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-1d12e93f-7d65-42e8-9cf8-5cc79df006f5" released by "delete_volume" :: held 0.835s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Created reservations ['c725133f-bd5c-42c5-9d40-d6c27e70f15c', 'fdbdf745-eb1d-4c60-bf6f-6f2c96886314', '815dffe3-e266-428a-8d8c-f6c0312d5bcd', 'cb517af6-0e7f-4ba7-b319-257d340f28f5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:27 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:27 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Creating offline snapshot 2cabe3a9-6d20-48ae-993d-85d9a773fca3 of volume 693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-fdfbb685-941d-4465-a475-a6f84dd8db95-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466.079c8258-6a78-404e-8747-4b1fb3a4ebf6" returned: 0 in 0.404s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0e1922-5680-4273-9a3a-796c05bb9cd5]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-079c8258-6a78-404e-8747-4b1fb3a4ebf6" released by "_delete_snapshot" :: held 1.839s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-fdfbb685-941d-4465-a475-a6f84dd8db95-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-cc6c244e-23f5-476f-b1a8-b0646e501466" released by "delete_snapshot" :: held 1.881s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "cinder-quobyte-fdfbb685-941d-4465-a475-a6f84dd8db95" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:27 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Created reservations ['e36925a0-0eab-4e0c-823c-9062d4e131fd', '263df0e3-62cf-4699-8a41-9082dc91b1bf', '01aed2a3-f5e6-464f-bd4d-4e7b1c250460', '51aab219-8ce5-451e-8994-f4032adc06c1'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-fdfbb685-941d-4465-a475-a6f84dd8db95" acquired by "delete_volume" :: waited 0.029s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:28 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c8c846-0f08-4d75-b858-c7a600fc9ea6]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.376s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Deleted volume successfully. Nov 02 10:55:28 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba Nov 02 10:55:28 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-2d9d8746-e750-4e67-985c-3fba08865769 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-1d12e93f-7d65-42e8-9cf8-5cc79df006f5-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90e9cf71-073c-4d23-99a3-0bdd091484da tempest-ProjectMemberTests-612057540 None] Lock "cinder-079c8258-6a78-404e-8747-4b1fb3a4ebf6-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-cc6c244e-23f5-476f-b1a8-b0646e501466-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:28 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Lock "cinder-cc6c244e-23f5-476f-b1a8-b0646e501466-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:28 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-cc6c244e-23f5-476f-b1a8-b0646e501466" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-cc6c244e-23f5-476f-b1a8-b0646e501466" acquired by "delete_volume" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0ae71-887d-4603-8277-522b84271756]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba" returned: 0 in 0.651s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 Nov 02 10:55:28 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 1G Nov 02 10:55:28 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95" returned: 0 in 0.564s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95 Nov 02 10:55:28 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466" returned: 0 in 0.457s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466 Nov 02 10:55:28 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-fdfbb685-941d-4465-a475-a6f84dd8db95" returned: 0 in 0.356s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-quobyte-fdfbb685-941d-4465-a475-a6f84dd8db95" released by "delete_volume" :: held 1.002s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:29 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 1G" returned: 0 in 0.520s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693b5889-6406-4f71-908a-7de7c9354aba -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693b5889-6406-4f71-908a-7de7c9354aba -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 Nov 02 10:55:29 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Created reservations ['63b05ee9-4820-4d07-a9b5-a54a15fdc5fa', 'bf7546d9-c14d-473c-b2a6-b4b1d5346dce', 'd848404d-bad7-4f1c-a4aa-16e27c8fb21c', '9e0d2087-8795-4b8a-822c-ffe6c9f6b3f9'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:29 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cc6c244e-23f5-476f-b1a8-b0646e501466" returned: 0 in 0.309s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-cc6c244e-23f5-476f-b1a8-b0646e501466" released by "delete_volume" :: held 0.870s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:29 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Created reservations ['f4289746-b255-4dcd-94ac-2375b12043d2', 'd086ebb8-b05a-46d4-99cf-3bdb1088fa15', '7ec08e40-808c-4583-a234-64f3ae20657d', '4e8ad8fd-a221-4a1d-8bc2-4eb484280d50'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:29 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693b5889-6406-4f71-908a-7de7c9354aba -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3" returned: 0 in 0.435s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 is being set with open permissions: ugo+rw Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 Nov 02 10:55:29 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Deleted volume successfully. Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e9cd7632-11c1-46f4-8911-8fa99efa3025 tempest-VolumeDependencyTests-1111044037 None] Lock "cinder-fdfbb685-941d-4465-a475-a6f84dd8db95-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:29 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.323s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e35cf52e-241e-4de2-9fb2-5664a841946a tempest-ProjectMemberTests-612057540 None] Lock "cinder-cc6c244e-23f5-476f-b1a8-b0646e501466-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:29 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3" returned: 0 in 0.345s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info Nov 02 10:55:29 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (52b7bdd1-e4b0-49b0-bba7-eab066178be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da2f7c9-6f43-487e-b514-464f5884520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:30 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da2f7c9-6f43-487e-b514-464f5884520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75315708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:30Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b81ffc-d835-443b-afc1-339f6a5b547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b81ffc-d835-443b-afc1-339f6a5b547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f3911f-764d-42b1-835a-846413eb7f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f3911f-764d-42b1-835a-846413eb7f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf', 'volume_name': 'volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9717fc-3e8a-416d-bb2d-6ebae8f1e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9717fc-3e8a-416d-bb2d-6ebae8f1e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44983bc-ebfb-4e46-80b3-81459afd3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:30 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Volume 78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf', 'volume_size': 1} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info" returned: 0 in 0.413s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info is being set with open permissions: ugo+rw Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info Nov 02 10:55:30 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.info" returned: 0 in 0.287s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75315708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:30Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Creating volume 78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:30 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf 1073741824 Nov 02 10:55:30 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-9eb39ac2-7741-452e-9667-e93da258acc4 tempest-ProjectReaderTests-679075022 None] Create snapshot completed successfully Nov 02 10:55:31 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf 1073741824" returned: 0 in 0.649s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-2cabe3a9-6d20-48ae-993d-85d9a773fca3-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Lock "cinder-2cabe3a9-6d20-48ae-993d-85d9a773fca3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-693b5889-6406-4f71-908a-7de7c9354aba" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-693b5889-6406-4f71-908a-7de7c9354aba" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-2cabe3a9-6d20-48ae-993d-85d9a773fca3" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-2cabe3a9-6d20-48ae-993d-85d9a773fca3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:31 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf Nov 02 10:55:31 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Deleting offline snapshot 2cabe3a9-6d20-48ae-993d-85d9a773fca3 of volume 693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] snapshot_file for this snap is: volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43138b-4d46-40ba-9b58-1f1a60eb7891]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:31 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 Nov 02 10:55:31 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:31 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44983bc-ebfb-4e46-80b3-81459afd3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e2b86f-73a6-4f1f-b953-20d84a022618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:31 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Volume volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf (78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf): created successfully Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e2b86f-73a6-4f1f-b953-20d84a022618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (52b7bdd1-e4b0-49b0-bba7-eab066178be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:31 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e9cea7da-ea04-4769-bfe5-94eb64e62b25 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:55:31 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3" returned: 0 in 0.482s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693b5889-6406-4f71-908a-7de7c9354aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa69c19-b643-4725-941d-5a64c2cc1874]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:31 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:32 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba Nov 02 10:55:32 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:32 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba" returned: 0 in 0.500s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Creating offline snapshot b2319fed-e2d7-43d2-b14e-b195478fbb5a of volume 78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:32 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 Nov 02 10:55:32 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3803bf-9912-4998-a45a-fad5b8e05c48]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:32 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf Nov 02 10:55:32 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:32 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3" returned: 0 in 0.459s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:32 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3 Nov 02 10:55:32 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:33 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" returned: 0 in 0.464s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a 1G Nov 02 10:55:33 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:33 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba.2cabe3a9-6d20-48ae-993d-85d9a773fca3" returned: 0 in 0.339s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-2cabe3a9-6d20-48ae-993d-85d9a773fca3" released by "_delete_snapshot" :: held 1.936s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-693b5889-6406-4f71-908a-7de7c9354aba" released by "delete_snapshot" :: held 1.966s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Created reservations ['fe1f62f4-f53f-4b53-9fdf-aa98c598fad3', '868272d6-076c-4f3c-bd6e-13872e935eca', '1dbc458b-d9ee-47ac-b117-627e004cd634', '935776a4-ada4-4178-853c-99c51765651f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:33 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Delete snapshot completed successfully. Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6603efb6-82f2-4e7a-bb83-6312e9c2241d tempest-ProjectReaderTests-679075022 None] Lock "cinder-2cabe3a9-6d20-48ae-993d-85d9a773fca3-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:33 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a 1G" returned: 0 in 0.709s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a Nov 02 10:55:33 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a" returned: 0 in 0.368s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:34 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a is being set with open permissions: ugo+rw Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:34 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a Nov 02 10:55:34 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:34 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info Nov 02 10:55:34 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-693b5889-6406-4f71-908a-7de7c9354aba-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Lock "cinder-693b5889-6406-4f71-908a-7de7c9354aba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-693b5889-6406-4f71-908a-7de7c9354aba" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:34 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info" returned: 0 in 0.296s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:34 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info is being set with open permissions: ugo+rw Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-693b5889-6406-4f71-908a-7de7c9354aba" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:34 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info Nov 02 10:55:34 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b049ce71-c612-44a9-86bd-c82a10c2058d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:34 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba Nov 02 10:55:34 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.info" returned: 0 in 0.302s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:35 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-58d3f8dc-cb40-4934-b05c-e92f71dbd524 tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:55:35 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba" returned: 0 in 0.479s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba Nov 02 10:55:35 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-693b5889-6406-4f71-908a-7de7c9354aba" returned: 0 in 0.267s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-693b5889-6406-4f71-908a-7de7c9354aba" released by "delete_volume" :: held 0.846s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Created reservations ['337226d6-6df7-4617-8c3a-87c657f932d1', '01d07e7d-7949-4a60-ab31-fb8f7f3ba53a', '4af1f90a-08b8-4f41-8e82-45f8237d1ef2', 'cc814a60-a646-4b5a-80c6-bd431d25a12f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:35 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-b2319fed-e2d7-43d2-b14e-b195478fbb5a-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Lock "cinder-b2319fed-e2d7-43d2-b14e-b195478fbb5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-b2319fed-e2d7-43d2-b14e-b195478fbb5a" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-b2319fed-e2d7-43d2-b14e-b195478fbb5a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot b2319fed-e2d7-43d2-b14e-b195478fbb5a of volume 78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110ad55-14d7-43c6-8ccc-27512a437ab9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.347s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Deleted volume successfully. Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-99b2ad50-c8c2-4c38-b64e-1796a56508c3 tempest-ProjectReaderTests-679075022 None] Lock "cinder-693b5889-6406-4f71-908a-7de7c9354aba-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:36 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a Nov 02 10:55:36 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a" returned: 0 in 0.498s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f30d99a-888d-47f4-8a13-fa11f3f9f6e1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (27714f72-c32d-4416-883a-45db0c390b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72567eb4-94ad-4701-b0ea-6bbcd32d066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72567eb4-94ad-4701-b0ea-6bbcd32d066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606716534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84ce9bd-9428-40eb-93de-1fc3130a02d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:36Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc75033d-674a-4525-879b-7b5c3b60384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf Nov 02 10:55:36 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc75033d-674a-4525-879b-7b5c3b60384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2a66a4-ad2c-421f-ac50-3f014ffe5af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2a66a4-ad2c-421f-ac50-3f014ffe5af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84ce9bd-9428-40eb-93de-1fc3130a02d2', 'volume_name': 'volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83e5873-9335-4a9e-8059-aee8edff5a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83e5873-9335-4a9e-8059-aee8edff5a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e22be14-6f5f-44ac-a0f9-be94b18acfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Volume b84ce9bd-9428-40eb-93de-1fc3130a02d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2', 'volume_size': 1} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606716534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84ce9bd-9428-40eb-93de-1fc3130a02d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:36Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Creating volume b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:36 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 1073741824 Nov 02 10:55:36 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" returned: 0 in 0.515s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a Nov 02 10:55:37 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 1073741824" returned: 0 in 0.646s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 Nov 02 10:55:37 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a" returned: 0 in 0.542s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a Nov 02 10:55:37 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2" returned: 0 in 0.345s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e22be14-6f5f-44ac-a0f9-be94b18acfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c415fd-d167-4536-9f9f-a2d4619ae543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:37 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Volume volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 (b84ce9bd-9428-40eb-93de-1fc3130a02d2): created successfully Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c415fd-d167-4536-9f9f-a2d4619ae543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (27714f72-c32d-4416-883a-45db0c390b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e9ad223d-96eb-47ca-a3f5-c26e27452ef1 tempest-ProjectReaderTests-679075022 None] Created volume successfully. Nov 02 10:55:37 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf.b2319fed-e2d7-43d2-b14e-b195478fbb5a" returned: 0 in 0.283s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-b2319fed-e2d7-43d2-b14e-b195478fbb5a" released by "_delete_snapshot" :: held 2.002s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" released by "delete_snapshot" :: held 2.032s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Created reservations ['e8de3afc-638c-478a-9e90-57884ffd52fa', 'b17bd3bf-9743-4725-916e-1642afeea39a', '8fc36d0d-a3cc-43da-9ade-2028b9f02300', '32afceaa-46aa-4450-bd09-334441eaec82'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:55:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-975b7f51-397d-4056-a281-280cfcf6e117 tempest-ProjectMemberTests-612057540 None] Lock "cinder-b2319fed-e2d7-43d2-b14e-b195478fbb5a-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=328,cinder:SELECT=255,cinder:DELETE=30,cinder:INSERT=83 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=233,cinder:UPDATE=326,cinder:INSERT=93,cinder:DELETE=28 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Creating offline snapshot 71fb6199-be14-4b86-af53-f14c5c65aa05 of volume b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b66e3e-abc2-4c03-9e5f-2b5c59c13774]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 Nov 02 10:55:38 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Lock "cinder-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed766df3-af72-4911-90e2-df73547b1f8d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:39 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2" returned: 0 in 0.500s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:39 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf Nov 02 10:55:39 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:39 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 1G Nov 02 10:55:39 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:39 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" returned: 0 in 0.434s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:39 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf Nov 02 10:55:39 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:39 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 1G" returned: 0 in 0.593s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:39 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 Nov 02 10:55:40 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:40 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf" released by "delete_volume" :: held 0.863s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Created reservations ['7db2980f-564e-4db7-8c08-8a4b32d3578a', '2c530729-5c13-4487-8724-76407c0c5ba7', 'aaea592c-8022-4953-ba72-4645e1538057', '03915fe8-7257-4ead-a1a8-0273393084bd'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:40 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:40 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:40 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05" returned: 0 in 0.506s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:40 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 is being set with open permissions: ugo+rw Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:40 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 Nov 02 10:55:40 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (65280f1f-7547-4066-9e36-9db0ac4561ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3073996-07ed-4f4b-afed-2dccea342378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3073996-07ed-4f4b-afed-2dccea342378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894330018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2038858e-beb6-46ff-a78a-052d0a090fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:40Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fd0f19-2170-480a-a3cb-e9b16f291268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fd0f19-2170-480a-a3cb-e9b16f291268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b83fe2-b95d-4e08-a6bc-fbc2918a54d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b83fe2-b95d-4e08-a6bc-fbc2918a54d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2038858e-beb6-46ff-a78a-052d0a090fd9', 'volume_name': 'volume-2038858e-beb6-46ff-a78a-052d0a090fd9', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646f1a7a-83cd-4143-b68b-d631f34f6b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646f1a7a-83cd-4143-b68b-d631f34f6b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1687a6a2-b6a3-4dc6-b077-f94e86a4284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Volume 2038858e-beb6-46ff-a78a-052d0a090fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2038858e-beb6-46ff-a78a-052d0a090fd9', 'volume_size': 1} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.445s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:40 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-31ee49e2-e6d6-40f5-b644-15215614453f tempest-ProjectMemberTests-612057540 None] Lock "cinder-78ae0d62-c9f3-4f30-b7fa-11aa1ce9c4bf-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:40 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05" returned: 0 in 0.351s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:40 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info Nov 02 10:55:40 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (2063b443-38e0-4667-9866-671ccc5d8080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9970d8e9-6abb-4ab4-bbfc-d37017c7259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9970d8e9-6abb-4ab4-bbfc-d37017c7259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855513290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dae257-d4da-431f-8eaa-bf5aad2777df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:41Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58853286-300d-4843-990d-6d7180b68939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58853286-300d-4843-990d-6d7180b68939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:41 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78781380-f8a0-4e21-b54c-882667bb5f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78781380-f8a0-4e21-b54c-882667bb5f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82dae257-d4da-431f-8eaa-bf5aad2777df', 'volume_name': 'volume-82dae257-d4da-431f-8eaa-bf5aad2777df', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f5b801-07fe-47ff-bdc9-1ed59aadd511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f5b801-07fe-47ff-bdc9-1ed59aadd511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7617de4-65fa-48bd-a722-ab8dfd3ba7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:41 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Volume 82dae257-d4da-431f-8eaa-bf5aad2777df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82dae257-d4da-431f-8eaa-bf5aad2777df', 'volume_size': 1} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info" returned: 0 in 0.305s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:41 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info is being set with open permissions: ugo+rw Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:41 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info Nov 02 10:55:41 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:41 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.info" returned: 0 in 0.289s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894330018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2038858e-beb6-46ff-a78a-052d0a090fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:40Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Creating volume 2038858e-beb6-46ff-a78a-052d0a090fd9 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:41 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:41 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 1073741824 Nov 02 10:55:41 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-81d10ca8-c83f-4b4f-b728-873c0b741a50 tempest-ProjectReaderTests-679075022 None] Create snapshot completed successfully Nov 02 10:55:41 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 1073741824" returned: 0 in 0.488s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-71fb6199-be14-4b86-af53-f14c5c65aa05-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Lock "cinder-71fb6199-be14-4b86-af53-f14c5c65aa05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-b84ce9bd-9428-40eb-93de-1fc3130a02d2" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:42 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 Nov 02 10:55:42 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-b84ce9bd-9428-40eb-93de-1fc3130a02d2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-71fb6199-be14-4b86-af53-f14c5c65aa05" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-71fb6199-be14-4b86-af53-f14c5c65aa05" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Deleting offline snapshot 71fb6199-be14-4b86-af53-f14c5c65aa05 of volume b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] snapshot_file for this snap is: volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb2c48-d548-4e46-9426-107683531415]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:42 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 Nov 02 10:55:42 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:42 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9" returned: 0 in 0.276s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.145s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855513290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dae257-d4da-431f-8eaa-bf5aad2777df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:41Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Creating volume 82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:42 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1687a6a2-b6a3-4dc6-b077-f94e86a4284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2038858e-beb6-46ff-a78a-052d0a090fd9', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29e82bd-ab91-45b0-a85f-c54416febed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:42 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df 1073741824 Nov 02 10:55:42 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:42 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Volume volume-2038858e-beb6-46ff-a78a-052d0a090fd9 (2038858e-beb6-46ff-a78a-052d0a090fd9): created successfully Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29e82bd-ab91-45b0-a85f-c54416febed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (65280f1f-7547-4066-9e36-9db0ac4561ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:42 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8706628a-4431-45b1-813a-7b804d99f018 tempest-ProjectReaderTests-1393700811 None] Created volume successfully. Nov 02 10:55:42 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05" returned: 0 in 0.476s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a422a43-567f-4e00-8491-aff9270df1b3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:42 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 Nov 02 10:55:42 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:42 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-2038858e-beb6-46ff-a78a-052d0a090fd9-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df 1073741824" returned: 0 in 0.574s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Lock "cinder-2038858e-beb6-46ff-a78a-052d0a090fd9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-quobyte-2038858e-beb6-46ff-a78a-052d0a090fd9" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-2038858e-beb6-46ff-a78a-052d0a090fd9" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:43 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df Nov 02 10:55:43 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1ad3d5-23d3-42a8-8da8-61e719a15975]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 Nov 02 10:55:43 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2" returned: 0 in 0.555s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 Nov 02 10:55:43 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7617de4-65fa-48bd-a722-ab8dfd3ba7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82dae257-d4da-431f-8eaa-bf5aad2777df', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728656e2-ae1a-4405-985d-3b2f68e96b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:43 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Volume volume-82dae257-d4da-431f-8eaa-bf5aad2777df (82dae257-d4da-431f-8eaa-bf5aad2777df): created successfully Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728656e2-ae1a-4405-985d-3b2f68e96b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (2063b443-38e0-4667-9866-671ccc5d8080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:43 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-85e9100c-a148-47b1-b451-a8234c102be7 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:55:43 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9" returned: 0 in 0.434s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9 Nov 02 10:55:43 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05" returned: 0 in 0.391s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05 Nov 02 10:55:43 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2038858e-beb6-46ff-a78a-052d0a090fd9" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-2038858e-beb6-46ff-a78a-052d0a090fd9" released by "delete_volume" :: held 0.787s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Created reservations ['d108ed65-65c7-4868-9dab-5bdf2d88f04f', 'd691cd2d-918c-438d-8f5f-5252cbf24444', '3d0e1834-9670-4e0d-8fce-01e8dd8eeb7a', '95dcbe27-2ad9-41e4-b216-e689c4f1f60e'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2.71fb6199-be14-4b86-af53-f14c5c65aa05" returned: 0 in 0.296s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:43 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-71fb6199-be14-4b86-af53-f14c5c65aa05" released by "_delete_snapshot" :: held 1.852s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:43 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-b84ce9bd-9428-40eb-93de-1fc3130a02d2" released by "delete_snapshot" :: held 1.883s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Flow 'volume_create_manager' (b91b342d-c0a1-457f-87dd-2ffd4a7ddeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b345bf2-197b-41e2-b7f0-837e2687e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Created reservations ['1b90d34d-2a6f-4e03-a1bb-eabfcb9629b8', '4bf6c7f9-2643-40ec-a42d-ea806ebcd204', '7f75f109-6a28-4f04-9bb0-698881d646f0', '453351bb-a3cf-484a-adad-aad7cc11469c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b345bf2-197b-41e2-b7f0-837e2687e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213771440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74ddb57-d172-4e0a-80c1-f0a6bad228a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2e82d26b4d4d93a09871cc8d90d78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:44Z,use_quota=True,user_id='aae0b25d89bc4cbb9b2df2a49d854d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849dcefe-5b38-4653-a37a-50ff05ae80e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849dcefe-5b38-4653-a37a-50ff05ae80e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738a6eca-20cd-412e-a816-8411a333e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738a6eca-20cd-412e-a816-8411a333e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74ddb57-d172-4e0a-80c1-f0a6bad228a6', 'volume_name': 'volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f7eab9-6549-4c14-90b4-005be63f0859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f7eab9-6549-4c14-90b4-005be63f0859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dddc67-d049-4310-a4ea-62e067a88725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Volume f74ddb57-d172-4e0a-80c1-f0a6bad228a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6', 'volume_size': 1} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213771440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74ddb57-d172-4e0a-80c1-f0a6bad228a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2e82d26b4d4d93a09871cc8d90d78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:44Z,use_quota=True,user_id='aae0b25d89bc4cbb9b2df2a49d854d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Creating volume f74ddb57-d172-4e0a-80c1-f0a6bad228a6 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:44 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:44 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.312s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:44 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 1073741824 Nov 02 10:55:44 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Deleted volume successfully. Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-a2ae7786-29e1-4138-82d6-ec089d5e2c1f tempest-ProjectReaderTests-1393700811 None] Lock "cinder-2038858e-beb6-46ff-a78a-052d0a090fd9-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Delete snapshot completed successfully. Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-eb495f3a-530d-422e-b4b4-1548ae98ed6b tempest-ProjectReaderTests-679075022 None] Lock "cinder-71fb6199-be14-4b86-af53-f14c5c65aa05-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (72a5003f-b233-4e5f-bd1d-ca3bde7f7fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4460b5-3df3-4ec2-996d-0f77a76cfdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4460b5-3df3-4ec2-996d-0f77a76cfdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1634448059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb59e4c-5364-4c46-9752-dd941817ba9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:45Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2dde5c-10a8-48e5-ab61-d2ce1026bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2dde5c-10a8-48e5-ab61-d2ce1026bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f921be5-d174-4416-b0a5-f37a6ae00674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f921be5-d174-4416-b0a5-f37a6ae00674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb59e4c-5364-4c46-9752-dd941817ba9d', 'volume_name': 'volume-7cb59e4c-5364-4c46-9752-dd941817ba9d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84994473-0403-412c-b0c3-6b3617c5cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84994473-0403-412c-b0c3-6b3617c5cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6685636-a6c6-435e-94cf-faf2c5dc57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:44 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Volume 7cb59e4c-5364-4c46-9752-dd941817ba9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb59e4c-5364-4c46-9752-dd941817ba9d', 'volume_size': 1} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 1073741824" returned: 0 in 0.587s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:44 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 Nov 02 10:55:44 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:45 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.427s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dddc67-d049-4310-a4ea-62e067a88725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7e2015-160a-4e9d-9349-27532997a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Creating offline snapshot 5cb6a249-3c4a-4d2e-8704-1e503c778e34 of volume 82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:45 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Volume volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 (f74ddb57-d172-4e0a-80c1-f0a6bad228a6): created successfully Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7e2015-160a-4e9d-9349-27532997a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Flow 'volume_create_manager' (b91b342d-c0a1-457f-87dd-2ffd4a7ddeff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe376fa4-f7e3-4319-b17a-b47f327178c7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:45 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2f700949-4124-45da-8a11-79278aef65e6 tempest-ProjectReaderTests-1918069990 None] Created volume successfully. Nov 02 10:55:45 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df Nov 02 10:55:45 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-b84ce9bd-9428-40eb-93de-1fc3130a02d2-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Lock "cinder-b84ce9bd-9428-40eb-93de-1fc3130a02d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-b84ce9bd-9428-40eb-93de-1fc3130a02d2" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-b84ce9bd-9428-40eb-93de-1fc3130a02d2" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ecd189-f4f0-4e80-81f4-0ac91d1cae50]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:45 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df" returned: 0 in 0.379s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:45 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 Nov 02 10:55:45 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:45 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 1G Nov 02 10:55:45 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:45 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2" returned: 0 in 0.428s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:45 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2 Nov 02 10:55:45 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:45 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 1G" returned: 0 in 0.474s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dae257-d4da-431f-8eaa-bf5aad2777df -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:46 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dae257-d4da-431f-8eaa-bf5aad2777df -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 Nov 02 10:55:46 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:46 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-b84ce9bd-9428-40eb-93de-1fc3130a02d2" returned: 0 in 0.282s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-b84ce9bd-9428-40eb-93de-1fc3130a02d2" released by "delete_volume" :: held 0.778s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Created reservations ['ace33130-ae54-4042-941b-02b6b54ffa51', '0ed772fe-c8c5-484b-b504-fbf91ad36dec', 'c5ef8f28-87ef-479e-8e95-4ff5ba4dc80c', 'fc9989af-a5fb-4524-98fb-fead1a5b9192'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "cinder-f74ddb57-d172-4e0a-80c1-f0a6bad228a6-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:46 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dae257-d4da-431f-8eaa-bf5aad2777df -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34" returned: 0 in 0.332s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 is being set with open permissions: ugo+rw Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:46 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:46 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-f74ddb57-d172-4e0a-80c1-f0a6bad228a6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:46 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 Nov 02 10:55:46 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "cinder-quobyte-f74ddb57-d172-4e0a-80c1-f0a6bad228a6" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-quobyte-f74ddb57-d172-4e0a-80c1-f0a6bad228a6" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f750944-7f09-448e-945a-4ff63940cd0c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:46 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 Nov 02 10:55:46 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:46 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.299s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Deleted volume successfully. Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-f5dd85f6-a884-4178-8739-28103713a843 tempest-ProjectReaderTests-679075022 None] Lock "cinder-b84ce9bd-9428-40eb-93de-1fc3130a02d2-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:46 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34" returned: 0 in 0.327s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:46 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info Nov 02 10:55:46 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:46 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6" returned: 0 in 0.434s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:46 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6 Nov 02 10:55:46 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:46 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info" returned: 0 in 0.296s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:46 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info is being set with open permissions: ugo+rw Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:47 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info Nov 02 10:55:47 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (a75a4dd2-987d-4edd-9104-49d2eb21764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d468fa-8a53-4fe6-a22b-31ed71fa2db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d468fa-8a53-4fe6-a22b-31ed71fa2db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773815536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1b8eff-afff-4745-956a-4e303bb7a2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:47Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61507a5e-149f-4c1a-8196-d1ab4d26cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61507a5e-149f-4c1a-8196-d1ab4d26cf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3914a876-a05a-44a1-9744-2c70193a1680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3914a876-a05a-44a1-9744-2c70193a1680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1b8eff-afff-4745-956a-4e303bb7a2b4', 'volume_name': 'volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319168e2-a1f2-42e7-a66f-bd3844c38cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319168e2-a1f2-42e7-a66f-bd3844c38cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b5a3f1-ae59-4f0c-b701-ba73e6fc5ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:47 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Volume 1e1b8eff-afff-4745-956a-4e303bb7a2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4', 'volume_size': 1} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:47 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-f74ddb57-d172-4e0a-80c1-f0a6bad228a6" returned: 0 in 0.278s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-quobyte-f74ddb57-d172-4e0a-80c1-f0a6bad228a6" released by "delete_volume" :: held 0.775s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Created reservations ['c67a4b89-7c15-4e0f-b75e-b4e7f9251939', 'fb1f435b-f292-4a93-ac0f-7501abd3d990', '2ce32ffe-32c8-4340-a043-df320c26f662', '88e2fa0b-128d-4b83-a94a-4b3c9b906f2b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:47 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.info" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1634448059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb59e4c-5364-4c46-9752-dd941817ba9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:45Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Creating volume 7cb59e4c-5364-4c46-9752-dd941817ba9d {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:47 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:47 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d 1073741824 Nov 02 10:55:47 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ec9fb902-0619-4de4-a7c9-01e43529251e tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:55:47 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:47 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:47 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.261s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:47 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Deleted volume successfully. Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-4f8f9951-cf34-4a1a-b577-d48e0e8ce233 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-f74ddb57-d172-4e0a-80c1-f0a6bad228a6-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-5cb6a249-3c4a-4d2e-8704-1e503c778e34-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Lock "cinder-5cb6a249-3c4a-4d2e-8704-1e503c778e34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-82dae257-d4da-431f-8eaa-bf5aad2777df" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-82dae257-d4da-431f-8eaa-bf5aad2777df" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-5cb6a249-3c4a-4d2e-8704-1e503c778e34" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5cb6a249-3c4a-4d2e-8704-1e503c778e34" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot 5cb6a249-3c4a-4d2e-8704-1e503c778e34 of volume 82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:47 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d 1073741824" returned: 0 in 0.583s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6625af82-6089-4633-a988-88f4ac2a113b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:47 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:47 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d Nov 02 10:55:47 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Flow 'volume_create_manager' (686bd19b-3786-42eb-b06f-d2f002c3b6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:48 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 Nov 02 10:55:48 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31533f2b-2a8b-430c-a1f4-e777c05f0d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31533f2b-2a8b-430c-a1f4-e777c05f0d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1419954498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48096fbc-5cb0-49d3-a5c1-abcf57fbb20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2e82d26b4d4d93a09871cc8d90d78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:48Z,use_quota=True,user_id='aae0b25d89bc4cbb9b2df2a49d854d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316b1a08-9cc5-40b1-b5c5-918714728d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316b1a08-9cc5-40b1-b5c5-918714728d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a161496d-9f8b-4f0b-91e3-31deef212a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a161496d-9f8b-4f0b-91e3-31deef212a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48096fbc-5cb0-49d3-a5c1-abcf57fbb20a', 'volume_name': 'volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70aa5259-61dd-4d39-b3cc-25583d0888f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70aa5259-61dd-4d39-b3cc-25583d0888f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91551c2-2e9e-42f9-af55-0443b2fb30c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Volume 48096fbc-5cb0-49d3-a5c1-abcf57fbb20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a', 'volume_size': 1} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:48 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773815536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1b8eff-afff-4745-956a-4e303bb7a2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:47Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Creating volume 1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6685636-a6c6-435e-94cf-faf2c5dc57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb59e4c-5364-4c46-9752-dd941817ba9d', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:48 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 1073741824 Nov 02 10:55:48 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34afd2d7-0052-4204-a864-48c7f5c08501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:48 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Volume volume-7cb59e4c-5364-4c46-9752-dd941817ba9d (7cb59e4c-5364-4c46-9752-dd941817ba9d): created successfully Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34afd2d7-0052-4204-a864-48c7f5c08501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (72a5003f-b233-4e5f-bd1d-ca3bde7f7fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:48 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34" returned: 0 in 0.412s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dae257-d4da-431f-8eaa-bf5aad2777df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:48 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-88f0e260-4493-4d4e-a7d5-afcb780999fc tempest-ProjectReaderTests-1393700811 None] Created volume successfully. Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f67e4-35e8-4ab1-85f2-0b1a76cbc8ed]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:48 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df Nov 02 10:55:48 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:48 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 1073741824" returned: 0 in 0.432s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:48 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df" returned: 0 in 0.386s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:48 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 Nov 02 10:55:48 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:48 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 Nov 02 10:55:48 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:48 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4" returned: 0 in 0.263s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1419954498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48096fbc-5cb0-49d3-a5c1-abcf57fbb20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2e82d26b4d4d93a09871cc8d90d78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:48Z,use_quota=True,user_id='aae0b25d89bc4cbb9b2df2a49d854d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Creating volume 48096fbc-5cb0-49d3-a5c1-abcf57fbb20a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:48 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:48 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b5a3f1-ae59-4f0c-b701-ba73e6fc5ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b29354-ec6b-440c-bb67-8927300b040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a 1073741824 Nov 02 10:55:49 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Volume volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 (1e1b8eff-afff-4745-956a-4e303bb7a2b4): created successfully Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b29354-ec6b-440c-bb67-8927300b040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (a75a4dd2-987d-4edd-9104-49d2eb21764a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-7cb59e4c-5364-4c46-9752-dd941817ba9d-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-02d7addc-4c79-408d-947b-01781e3e5f55 tempest-ProjectReaderTests-679075022 None] Created volume successfully. Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Lock "cinder-7cb59e4c-5364-4c46-9752-dd941817ba9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:49 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34" returned: 0 in 0.424s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-quobyte-7cb59e4c-5364-4c46-9752-dd941817ba9d" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:49 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34 Nov 02 10:55:49 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-7cb59e4c-5364-4c46-9752-dd941817ba9d" acquired by "delete_volume" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3870e234-f9e5-4db1-b4e3-8ccc6682b52d]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d Nov 02 10:55:49 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df.5cb6a249-3c4a-4d2e-8704-1e503c778e34" returned: 0 in 0.281s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5cb6a249-3c4a-4d2e-8704-1e503c778e34" released by "_delete_snapshot" :: held 1.619s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-82dae257-d4da-431f-8eaa-bf5aad2777df" released by "delete_snapshot" :: held 1.656s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a 1073741824" returned: 0 in 0.528s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Created reservations ['06a8f323-5d65-4352-bcf5-7a66ee5c9a44', '816eb89c-9faa-4e66-b98a-5f33489bb097', 'ae157e1d-610c-4304-b9ad-f875b12b8b79', '400f4ad0-6c13-4b92-97ac-b86b6ec361c2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a Nov 02 10:55:49 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d" returned: 0 in 0.414s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-06d31865-754c-48ae-ac1b-e631c553a4ac tempest-ProjectMemberTests-612057540 None] Lock "cinder-5cb6a249-3c4a-4d2e-8704-1e503c778e34-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d Nov 02 10:55:49 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a" returned: 0 in 0.252s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91551c2-2e9e-42f9-af55-0443b2fb30c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caab2352-8051-4580-8eb0-cbbe31ac0bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Volume volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a (48096fbc-5cb0-49d3-a5c1-abcf57fbb20a): created successfully Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caab2352-8051-4580-8eb0-cbbe31ac0bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Flow 'volume_create_manager' (686bd19b-3786-42eb-b06f-d2f002c3b6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:49 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-59c7acf6-f01d-46d7-b841-80eb0044ac5f tempest-ProjectReaderTests-1918069990 None] Created volume successfully. Nov 02 10:55:49 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7cb59e4c-5364-4c46-9752-dd941817ba9d" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-7cb59e4c-5364-4c46-9752-dd941817ba9d" released by "delete_volume" :: held 0.721s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-82dae257-d4da-431f-8eaa-bf5aad2777df-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Lock "cinder-82dae257-d4da-431f-8eaa-bf5aad2777df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Created reservations ['dc362b7c-2de8-411a-94ae-2dca2abe3154', 'f2041990-4e87-4d9c-b85d-ac518106158d', '5fdb7e7c-ac49-4884-ac51-89672b97361d', 'fe525d52-fde5-4654-ac60-ec2b2dfd8843'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:49 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-82dae257-d4da-431f-8eaa-bf5aad2777df" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-82dae257-d4da-431f-8eaa-bf5aad2777df" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1af22-4ec8-497d-aff2-33aca8800e5a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "cinder-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:50 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:50 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df Nov 02 10:55:50 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "cinder-quobyte-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-quobyte-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5cd813-bc2a-4dfd-b9f1-4ddc5d0ba50f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Creating offline snapshot 337654b8-7708-428c-96e7-78d4306cd0d3 of volume 1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:50 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a Nov 02 10:55:50 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7babeb9-9800-4789-8ee9-1c4bb97a564c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.397s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:50 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Deleted volume successfully. Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-71835217-a103-4f7e-9383-590bb16a4ebe tempest-ProjectReaderTests-1393700811 None] Lock "cinder-7cb59e4c-5364-4c46-9752-dd941817ba9d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:50 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df" returned: 0 in 0.570s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 Nov 02 10:55:50 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df Nov 02 10:55:50 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a" returned: 0 in 0.572s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a Nov 02 10:55:50 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (55476d27-52d5-4a3d-a3ff-bb02e4d396de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:51 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8a8cdf-01b2-4adc-ac3d-07597004458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4" returned: 0 in 0.481s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-82dae257-d4da-431f-8eaa-bf5aad2777df" returned: 0 in 0.393s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 1G Nov 02 10:55:51 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8a8cdf-01b2-4adc-ac3d-07597004458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82903467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903df4ce-13fa-4c47-b34a-adc4310dff31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:51Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf0504-8360-40a6-900f-8abf3da21d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf0504-8360-40a6-900f-8abf3da21d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f892527-309e-4079-94ee-1f5bfd759e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f892527-309e-4079-94ee-1f5bfd759e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903df4ce-13fa-4c47-b34a-adc4310dff31', 'volume_name': 'volume-903df4ce-13fa-4c47-b34a-adc4310dff31', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656686ca-4640-4f33-b31f-1114fb95e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656686ca-4640-4f33-b31f-1114fb95e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45e7068-a7bc-4b6b-8c24-77853781601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:51 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Volume 903df4ce-13fa-4c47-b34a-adc4310dff31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903df4ce-13fa-4c47-b34a-adc4310dff31', 'volume_size': 1} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-82dae257-d4da-431f-8eaa-bf5aad2777df" released by "delete_volume" :: held 1.113s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Created reservations ['490593a6-8e53-44ea-9984-0ea33f366450', '0ed65aae-c446-492d-bd76-c168f115804e', '4ed4556d-6145-456d-9a6e-81689d94a44e', '0e103ba8-d5d5-4c8f-a9c8-89e1b35c9257'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:51 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a" returned: 0 in 0.303s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-quobyte-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a" released by "delete_volume" :: held 0.953s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Created reservations ['4660e0f2-e7c1-41a5-b18e-dfaa719e5565', '725d1ab7-cf84-4434-acf3-354dfffffa0f', '67af9adc-236c-485a-82d1-0bb4dddee18e', '634d4dda-052b-4b25-a2a9-09787e2351ec'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:51 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:51 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:51 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:51 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 1G" returned: 0 in 0.491s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 Nov 02 10:55:51 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:51 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-0f1e931e-7c54-4177-bb7d-dfa1b19c3f6d tempest-ProjectMemberTests-612057540 None] Lock "cinder-82dae257-d4da-431f-8eaa-bf5aad2777df-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:51 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.280s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:51 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Deleted volume successfully. Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-542506a6-c3c1-4282-a203-cf3e084a0d03 tempest-ProjectReaderTests-1918069990 None] Lock "cinder-48096fbc-5cb0-49d3-a5c1-abcf57fbb20a-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:51 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3" returned: 0 in 0.308s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 is being set with open permissions: ugo+rw Nov 02 10:55:51 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 Nov 02 10:55:51 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info Nov 02 10:55:52 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info" returned: 0 in 0.336s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:52 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info is being set with open permissions: ugo+rw Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info Nov 02 10:55:52 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (862b5f12-04b0-4901-a4c5-35b4e64bcbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137e6497-be99-482f-8a94-232582b723f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:52 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137e6497-be99-482f-8a94-232582b723f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299908280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff382dcf-101c-444d-aaae-0fdd24d464cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:53Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e5323-439f-4d15-aba1-fa239c7f89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e5323-439f-4d15-aba1-fa239c7f89e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd3bd18-9719-4dc6-822a-7c07f8d7d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd3bd18-9719-4dc6-822a-7c07f8d7d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff382dcf-101c-444d-aaae-0fdd24d464cb', 'volume_name': 'volume-ff382dcf-101c-444d-aaae-0fdd24d464cb', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0e235a-5a25-4ddb-995b-c34af644defa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0e235a-5a25-4ddb-995b-c34af644defa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4224e8-f0ec-4a56-ab7e-07a6dba5dd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:52 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Volume ff382dcf-101c-444d-aaae-0fdd24d464cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff382dcf-101c-444d-aaae-0fdd24d464cb', 'volume_size': 1} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.info" returned: 0 in 0.368s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82903467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903df4ce-13fa-4c47-b34a-adc4310dff31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:51Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Creating volume 903df4ce-13fa-4c47-b34a-adc4310dff31 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:52 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:52 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 1073741824 Nov 02 10:55:52 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-180b7519-b39a-40cb-8473-e984bee5ca09 tempest-ProjectReaderTests-679075022 None] Create snapshot completed successfully Nov 02 10:55:53 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 1073741824" returned: 0 in 0.486s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 Nov 02 10:55:53 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31" returned: 0 in 0.306s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299908280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff382dcf-101c-444d-aaae-0fdd24d464cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:53Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Creating volume ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:53 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-337654b8-7708-428c-96e7-78d4306cd0d3-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:53 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb 1073741824 Nov 02 10:55:53 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45e7068-a7bc-4b6b-8c24-77853781601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903df4ce-13fa-4c47-b34a-adc4310dff31', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef857cb-88ad-471b-b2ed-a6fbbc5398a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Lock "cinder-337654b8-7708-428c-96e7-78d4306cd0d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-1e1b8eff-afff-4745-956a-4e303bb7a2b4" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:53 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Volume volume-903df4ce-13fa-4c47-b34a-adc4310dff31 (903df4ce-13fa-4c47-b34a-adc4310dff31): created successfully Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef857cb-88ad-471b-b2ed-a6fbbc5398a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (55476d27-52d5-4a3d-a3ff-bb02e4d396de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1e1b8eff-afff-4745-956a-4e303bb7a2b4" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-337654b8-7708-428c-96e7-78d4306cd0d3" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:53 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a2cfd310-6039-4022-88fc-3cda30f0571b tempest-ProjectReaderTests-1393700811 None] Created volume successfully. Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-337654b8-7708-428c-96e7-78d4306cd0d3" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Deleting offline snapshot 337654b8-7708-428c-96e7-78d4306cd0d3 of volume 1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] snapshot_file for this snap is: volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca812e-4566-4090-863a-bdc6de912d64]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:53 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 Nov 02 10:55:54 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-903df4ce-13fa-4c47-b34a-adc4310dff31-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-903df4ce-13fa-4c47-b34a-adc4310dff31-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-quobyte-903df4ce-13fa-4c47-b34a-adc4310dff31" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-903df4ce-13fa-4c47-b34a-adc4310dff31" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[55287437-9eb6-4ecd-a99d-cec8f6fca1fa]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb 1073741824" returned: 0 in 0.642s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3" returned: 0 in 0.523s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:54 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb Nov 02 10:55:54 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7705e79d-8bae-4e43-90ea-5bbbcac1d494]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 Nov 02 10:55:54 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 Nov 02 10:55:54 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb" returned: 0 in 0.277s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4224e8-f0ec-4a56-ab7e-07a6dba5dd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff382dcf-101c-444d-aaae-0fdd24d464cb', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea524d0-40de-40df-aee2-02e367c48d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:54 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Volume volume-ff382dcf-101c-444d-aaae-0fdd24d464cb (ff382dcf-101c-444d-aaae-0fdd24d464cb): created successfully Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea524d0-40de-40df-aee2-02e367c48d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (862b5f12-04b0-4901-a4c5-35b4e64bcbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:54 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-162a8ea1-6b62-4942-b493-0d39fcb14643 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:55:54 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31" returned: 0 in 0.481s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31 Nov 02 10:55:54 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4" returned: 0 in 0.430s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 Nov 02 10:55:54 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-903df4ce-13fa-4c47-b34a-adc4310dff31" returned: 0 in 0.261s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-903df4ce-13fa-4c47-b34a-adc4310dff31" released by "delete_volume" :: held 0.792s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Created reservations ['9ec6a51d-5708-4d7f-830a-683b48b608df', '928b589c-ef40-4b5c-83a2-a3a532988f04', 'e40b9868-318f-4c4a-ada2-4169757e8ee8', '6c453665-e93f-4729-be7f-77c89b882805'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:55 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3" returned: 0 in 0.389s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3 Nov 02 10:55:55 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.270s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Deleted volume successfully. Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6028a4cd-8146-4035-970e-20f64a98c750 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-903df4ce-13fa-4c47-b34a-adc4310dff31-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:55 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4.337654b8-7708-428c-96e7-78d4306cd0d3" returned: 0 in 0.300s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-337654b8-7708-428c-96e7-78d4306cd0d3" released by "_delete_snapshot" :: held 1.785s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1e1b8eff-afff-4745-956a-4e303bb7a2b4" released by "delete_snapshot" :: held 1.824s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Created reservations ['8d701ba1-3bb3-42c7-b9b3-73af102dcc9a', '2cb43790-7a66-41e9-ba43-2d6d6c355a6c', '573c6cd8-823a-4567-975f-88d9ece60f44', 'dec098df-3909-4d34-96aa-57d6b3a64ca2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:55 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Delete snapshot completed successfully. Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-392764d7-27e8-4e3c-9248-c33fe271a858 tempest-ProjectReaderTests-679075022 None] Lock "cinder-337654b8-7708-428c-96e7-78d4306cd0d3-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-1e1b8eff-afff-4745-956a-4e303bb7a2b4-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (a9340d26-a00f-4118-b1e8-fdcfe8fe2bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4d5353-6c12-4fa5-8c5d-617831a7fa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:55 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Lock "cinder-1e1b8eff-afff-4745-956a-4e303bb7a2b4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4d5353-6c12-4fa5-8c5d-617831a7fa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477922456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fc7b4a-473c-4a07-87d1-7dfd409004cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:56Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4311e929-eb35-4502-a7db-198830abc1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4311e929-eb35-4502-a7db-198830abc1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea4e6fc-d611-47b0-97e7-824f68b2ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea4e6fc-d611-47b0-97e7-824f68b2ee81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fc7b4a-473c-4a07-87d1-7dfd409004cb', 'volume_name': 'volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8234a7-3878-472b-bcf4-4589d01a8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8234a7-3878-472b-bcf4-4589d01a8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96960a2e-5780-467b-a744-048eae18b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:56 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Volume a3fc7b4a-473c-4a07-87d1-7dfd409004cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb', 'volume_size': 1} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477922456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fc7b4a-473c-4a07-87d1-7dfd409004cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2472c3671768405dbc0879c9934b61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:56Z,use_quota=True,user_id='7d2fc9e74ee24a4c86eab55df6467b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Creating volume a3fc7b4a-473c-4a07-87d1-7dfd409004cb {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:56 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb 1073741824 Nov 02 10:55:56 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-1e1b8eff-afff-4745-956a-4e303bb7a2b4" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1e1b8eff-afff-4745-956a-4e303bb7a2b4" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[92037ae0-101b-4b58-9959-d1cc178f2198]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 Nov 02 10:55:56 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb 1073741824" returned: 0 in 0.518s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb Nov 02 10:55:56 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4" returned: 0 in 0.471s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4 Nov 02 10:55:56 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb" returned: 0 in 0.299s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.775s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:56 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96960a2e-5780-467b-a744-048eae18b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03916775-7a16-4853-bf07-612b60cac689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1e1b8eff-afff-4745-956a-4e303bb7a2b4" returned: 0 in 0.285s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Creating offline snapshot 6db926d3-b8ae-45f4-9c98-5d464e59a600 of volume ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[609e1ecd-bd62-4a96-a258-489a9abab882]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1e1b8eff-afff-4745-956a-4e303bb7a2b4" released by "delete_volume" :: held 0.857s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Volume volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb (a3fc7b4a-473c-4a07-87d1-7dfd409004cb): created successfully Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03916775-7a16-4853-bf07-612b60cac689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Flow 'volume_create_manager' (a9340d26-a00f-4118-b1e8-fdcfe8fe2bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-c805a276-50a2-442e-a39d-bed53d91f872 tempest-ProjectReaderTests-1393700811 None] Created volume successfully. Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Created reservations ['5c2e1a39-3a91-46c5-bb21-ec415c94e384', 'ecfdee86-3551-48c0-808c-47d2a88de049', '922f5646-396c-4f6c-816a-d5580832da96', '2a581986-8a82-41fb-a840-1e194fd6d27d'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:57 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb Nov 02 10:55:57 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:57 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:57 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:57 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb" returned: 0 in 0.434s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:57 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 1G Nov 02 10:55:57 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:57 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.276s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:57 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Deleted volume successfully. Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8c8ad49a-3726-44c2-a93f-19d46331223e tempest-ProjectReaderTests-679075022 None] Lock "cinder-1e1b8eff-afff-4745-956a-4e303bb7a2b4-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:57 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 1G" returned: 0 in 0.470s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff382dcf-101c-444d-aaae-0fdd24d464cb -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:57 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff382dcf-101c-444d-aaae-0fdd24d464cb -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 Nov 02 10:55:57 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-a3fc7b4a-473c-4a07-87d1-7dfd409004cb-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-a3fc7b4a-473c-4a07-87d1-7dfd409004cb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "cinder-quobyte-a3fc7b4a-473c-4a07-87d1-7dfd409004cb" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-a3fc7b4a-473c-4a07-87d1-7dfd409004cb" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b58659-0b6d-4589-a397-3d273e863ac4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb Nov 02 10:55:58 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff382dcf-101c-444d-aaae-0fdd24d464cb -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600" returned: 0 in 0.506s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:58 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 is being set with open permissions: ugo+rw Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 Nov 02 10:55:58 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:58 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb" returned: 0 in 0.554s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600" returned: 0 in 0.400s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:58 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb Nov 02 10:55:58 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (07b608b7-7531-4e6a-8282-d7e7170112f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b6ae76-067f-4f62-840a-aec04b0438c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b6ae76-067f-4f62-840a-aec04b0438c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197339533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6ba610-c624-4d38-b53f-d7a1caa6d20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:59Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info Nov 02 10:55:58 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9343a1e1-316c-47e3-bf96-26c499af5c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9343a1e1-316c-47e3-bf96-26c499af5c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d72728-36a4-4e88-b951-9c72b9a0b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d72728-36a4-4e88-b951-9c72b9a0b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6ba610-c624-4d38-b53f-d7a1caa6d20e', 'volume_name': 'volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c89f23-c912-47e2-a266-faba423dc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c89f23-c912-47e2-a266-faba423dc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d54a3-3508-4ca8-911f-61014b79464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Volume 1d6ba610-c624-4d38-b53f-d7a1caa6d20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e', 'volume_size': 1} Nov 02 10:55:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:59 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-a3fc7b4a-473c-4a07-87d1-7dfd409004cb" returned: 0 in 0.305s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-quobyte-a3fc7b4a-473c-4a07-87d1-7dfd409004cb" released by "delete_volume" :: held 0.948s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Created reservations ['83508a7b-f2bc-4dea-83f4-a6a398bc95ae', 'f08b2c7f-4110-40ee-9fa7-a72322d2b6a9', '75a5e066-5718-4d0f-a3e6-017444fb172b', 'c91c380f-be47-4533-83bd-2de7ab136b7f'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:59 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info is being set with open permissions: ugo+rw Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:59 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info Nov 02 10:55:59 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:59 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:55:59 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:59 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.info" returned: 0 in 0.343s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197339533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6ba610-c624-4d38-b53f-d7a1caa6d20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:59Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Creating volume 1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:59 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:59 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e 1073741824 Nov 02 10:55:59 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2400c856-1d51-4208-a835-dd012ba3a98e tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:55:59 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.382s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:59 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Deleted volume successfully. Nov 02 10:55:59 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-bf19c9d3-3591-4dc2-8bcd-59bd54e5b813 tempest-ProjectReaderTests-1393700811 None] Lock "cinder-a3fc7b4a-473c-4a07-87d1-7dfd409004cb-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:00 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e 1073741824" returned: 0 in 0.605s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:00 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e Nov 02 10:56:00 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-6db926d3-b8ae-45f4-9c98-5d464e59a600-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Lock "cinder-6db926d3-b8ae-45f4-9c98-5d464e59a600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-ff382dcf-101c-444d-aaae-0fdd24d464cb" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-ff382dcf-101c-444d-aaae-0fdd24d464cb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-6db926d3-b8ae-45f4-9c98-5d464e59a600" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-6db926d3-b8ae-45f4-9c98-5d464e59a600" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot 6db926d3-b8ae-45f4-9c98-5d464e59a600 of volume ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:00 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" returned: 0 in 0.340s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[710dc214-c0c1-4f0e-8871-d2789660f6bb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d54a3-3508-4ca8-911f-61014b79464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2dc393-aeb0-45dc-930c-3ee9166f8bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:00 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Volume volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e (1d6ba610-c624-4d38-b53f-d7a1caa6d20e): created successfully Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2dc393-aeb0-45dc-930c-3ee9166f8bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:00 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (07b608b7-7531-4e6a-8282-d7e7170112f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:00 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-00143a66-387c-4b46-b1b3-3db6b7940797 tempest-ProjectReaderTests-679075022 None] Created volume successfully. Nov 02 10:56:00 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 Nov 02 10:56:00 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600" returned: 0 in 0.440s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff382dcf-101c-444d-aaae-0fdd24d464cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44dd619-232a-47af-aa7c-d036133fd1a4]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Creating offline snapshot 4f2cc92a-d667-4738-84c1-3525b3559037 of volume 1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6465a-5682-4ca5-856e-fe800c6fdcf1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb Nov 02 10:56:01 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e Nov 02 10:56:01 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb" returned: 0 in 0.438s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 Nov 02 10:56:01 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" returned: 0 in 0.420s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 1G Nov 02 10:56:01 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600" returned: 0 in 0.354s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600 Nov 02 10:56:01 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 1G" returned: 0 in 0.449s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 Nov 02 10:56:02 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb.6db926d3-b8ae-45f4-9c98-5d464e59a600" returned: 0 in 0.286s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-6db926d3-b8ae-45f4-9c98-5d464e59a600" released by "_delete_snapshot" :: held 1.658s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-ff382dcf-101c-444d-aaae-0fdd24d464cb" released by "delete_snapshot" :: held 1.689s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Created reservations ['d4911bed-9223-4a9c-a75f-fe50db4a8a17', '0ac86f2b-f2a1-4d12-950b-6ee00c687562', '4aebdd1b-e93a-469a-8039-e67a6a1cafcd', '8ab8b65f-69c2-4821-905b-28a3cc748a98'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:02 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-20a93f57-f9ff-4aee-bdac-dbb945f4d764 tempest-ProjectMemberTests-612057540 None] Lock "cinder-6db926d3-b8ae-45f4-9c98-5d464e59a600-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:02 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037" returned: 0 in 0.345s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 is being set with open permissions: ugo+rw Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 Nov 02 10:56:02 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-ff382dcf-101c-444d-aaae-0fdd24d464cb-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Lock "cinder-ff382dcf-101c-444d-aaae-0fdd24d464cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:02 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037" returned: 0 in 0.295s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-ff382dcf-101c-444d-aaae-0fdd24d464cb" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:02 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info Nov 02 10:56:02 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-ff382dcf-101c-444d-aaae-0fdd24d464cb" acquired by "delete_volume" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44b3539-f583-4f6a-acb9-bab056b6ec11]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb Nov 02 10:56:02 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info" returned: 0 in 0.294s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info is being set with open permissions: ugo+rw Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info Nov 02 10:56:03 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb" returned: 0 in 0.400s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb Nov 02 10:56:03 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.info" returned: 0 in 0.248s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-cfddf2dc-3096-461c-ae09-e1ccd23e48d8 tempest-ProjectReaderTests-679075022 None] Create snapshot completed successfully Nov 02 10:56:03 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-ff382dcf-101c-444d-aaae-0fdd24d464cb" returned: 0 in 0.273s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-ff382dcf-101c-444d-aaae-0fdd24d464cb" released by "delete_volume" :: held 0.737s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Created reservations ['17d8cfad-4181-4956-8891-50137d2f3b44', '39ac3e46-dfe5-4271-8128-055413b4f2cf', '9b61e206-979e-4863-9aca-c3a4999d1faf', 'b9a0d5d6-5c74-4464-876c-40e396357196'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:03 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.243s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:03 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:56:03 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-6077ffc8-063a-49d8-a0f6-8af29f82e028 tempest-ProjectMemberTests-612057540 None] Lock "cinder-ff382dcf-101c-444d-aaae-0fdd24d464cb-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-4f2cc92a-d667-4738-84c1-3525b3559037-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Lock "cinder-4f2cc92a-d667-4738-84c1-3525b3559037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-4f2cc92a-d667-4738-84c1-3525b3559037" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-4f2cc92a-d667-4738-84c1-3525b3559037" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Deleting offline snapshot 4f2cc92a-d667-4738-84c1-3525b3559037 of volume 1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] snapshot_file for this snap is: volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0098fb-25ab-434f-aaf8-7073c745a21a]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (39e2e391-c459-495e-bd0f-e29f45779dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb70509-fc05-41c6-b35f-c443f8760ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb70509-fc05-41c6-b35f-c443f8760ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200052329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7154a423-e6b6-4445-bfa9-a3c2a22798d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:04Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25af862-9236-4e16-828b-c73b8132fec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25af862-9236-4e16-828b-c73b8132fec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725923ab-10a3-4589-87db-ec93e7e0bf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 Nov 02 10:56:04 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725923ab-10a3-4589-87db-ec93e7e0bf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7154a423-e6b6-4445-bfa9-a3c2a22798d1', 'volume_name': 'volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8769b56-2091-416b-8a15-314552220dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8769b56-2091-416b-8a15-314552220dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f695d5e8-3526-4c15-b196-5e5bb8d7216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Volume 7154a423-e6b6-4445-bfa9-a3c2a22798d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1', 'volume_size': 1} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200052329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7154a423-e6b6-4445-bfa9-a3c2a22798d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:04Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Creating volume 7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:04 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:04 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 1073741824 Nov 02 10:56:04 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:04 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037" returned: 0 in 0.390s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe804b22-76c2-404e-8060-0c36f4b1ef70]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:04 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e Nov 02 10:56:04 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 1073741824" returned: 0 in 0.502s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 Nov 02 10:56:05 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" returned: 0 in 0.405s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 Nov 02 10:56:05 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f695d5e8-3526-4c15-b196-5e5bb8d7216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a25bdfd-2f0e-490a-a02a-856a3135eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:05 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Volume volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 (7154a423-e6b6-4445-bfa9-a3c2a22798d1): created successfully Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a25bdfd-2f0e-490a-a02a-856a3135eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (39e2e391-c459-495e-bd0f-e29f45779dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-49208b4d-1a72-4dc4-97be-cb5b731acf45 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:56:05 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037" returned: 0 in 0.360s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037 Nov 02 10:56:05 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e.4f2cc92a-d667-4738-84c1-3525b3559037" returned: 0 in 0.243s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-4f2cc92a-d667-4738-84c1-3525b3559037" released by "_delete_snapshot" :: held 1.515s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" released by "delete_snapshot" :: held 1.542s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Created reservations ['d85f8d8f-c954-41c7-995b-349e57037a00', '5efdb1c2-c87c-431d-83fa-6e0ed253f7df', 'f9a2466d-35c2-400b-b2e3-4d70ed869442', '0a79e57d-4036-46e9-afe1-2b625bc6694a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:05 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Delete snapshot completed successfully. Nov 02 10:56:05 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-8dfaee9a-235a-4a01-8cbe-b66efa74d043 tempest-ProjectReaderTests-679075022 None] Lock "cinder-4f2cc92a-d667-4738-84c1-3525b3559037-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-1d6ba610-c624-4d38-b53f-d7a1caa6d20e-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Lock "cinder-1d6ba610-c624-4d38-b53f-d7a1caa6d20e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b652ca8-6aa4-44a3-b249-685018e53aac]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Creating offline snapshot d18b3058-a402-4087-818e-02873f9a1145 of volume 7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[966beafe-b7f4-4d2d-8200-51fa71e04b22]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:06 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e Nov 02 10:56:06 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:06 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 Nov 02 10:56:06 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:06 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" returned: 0 in 0.380s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:06 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e Nov 02 10:56:07 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:07 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1" returned: 0 in 0.414s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 1G Nov 02 10:56:07 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:07 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" returned: 0 in 0.253s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-1d6ba610-c624-4d38-b53f-d7a1caa6d20e" released by "delete_volume" :: held 0.731s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Created reservations ['db63e74a-8db7-408e-9911-f8c58384de5e', '223502d3-f2d7-44f1-80e3-b777d69286fd', '90f84578-df80-433f-8c7b-b583a8652178', 'ddd2f59f-9f87-498e-87a9-4eea63412333'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:07 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:07 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 1G" returned: 0 in 0.423s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 Nov 02 10:56:07 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:07 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.293s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:07 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Deleted volume successfully. Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-02c7ba51-3671-4480-bc7d-170b4851efb4 tempest-ProjectReaderTests-679075022 None] Lock "cinder-1d6ba610-c624-4d38-b53f-d7a1caa6d20e-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:07 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145" returned: 0 in 0.329s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:07 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 is being set with open permissions: ugo+rw Nov 02 10:56:07 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 Nov 02 10:56:07 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:08 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145" returned: 0 in 0.246s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:08 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info Nov 02 10:56:08 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (90035323-e11d-43ee-bceb-1092800ca8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a445887e-f5be-44a6-a844-635f22beb218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a445887e-f5be-44a6-a844-635f22beb218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988410480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5438d36c-e86f-4375-9cbc-30660104df8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:08Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80bdff9-fa76-40d6-97a7-cf482a408a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80bdff9-fa76-40d6-97a7-cf482a408a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828eca03-6d92-46df-a9f9-6e4e214fd634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828eca03-6d92-46df-a9f9-6e4e214fd634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5438d36c-e86f-4375-9cbc-30660104df8a', 'volume_name': 'volume-5438d36c-e86f-4375-9cbc-30660104df8a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3035c08c-220e-4fdb-91a1-3ea309291d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3035c08c-220e-4fdb-91a1-3ea309291d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b5198f-56a6-4e9c-ad2d-98e58026e761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:08 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Volume 5438d36c-e86f-4375-9cbc-30660104df8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5438d36c-e86f-4375-9cbc-30660104df8a', 'volume_size': 1} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:08 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:08 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info is being set with open permissions: ugo+rw Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:08 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info Nov 02 10:56:08 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:08 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.info" returned: 0 in 0.233s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988410480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5438d36c-e86f-4375-9cbc-30660104df8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae67e8f6a9c495bbf8c64f29d5e10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:08Z,use_quota=True,user_id='ea7ed652781a44d2aa7ca2f83c8fa6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Creating volume 5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:08 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:08 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:08 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a 1073741824 Nov 02 10:56:08 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:08 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6d56d458-a8ff-447c-90d8-640a9440662f tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:56:09 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a 1073741824" returned: 0 in 0.430s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:09 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a Nov 02 10:56:09 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:09 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a" returned: 0 in 0.239s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b5198f-56a6-4e9c-ad2d-98e58026e761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5438d36c-e86f-4375-9cbc-30660104df8a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca96cc7-1ce8-4ff0-8c29-abdd687fd27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:09 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Volume volume-5438d36c-e86f-4375-9cbc-30660104df8a (5438d36c-e86f-4375-9cbc-30660104df8a): created successfully Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca96cc7-1ce8-4ff0-8c29-abdd687fd27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Flow 'volume_create_manager' (90035323-e11d-43ee-bceb-1092800ca8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:09 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-521c7c67-d345-4f2f-8375-b7b9c7d821c5 tempest-ProjectReaderTests-679075022 None] Created volume successfully. Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-d18b3058-a402-4087-818e-02873f9a1145-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Lock "cinder-d18b3058-a402-4087-818e-02873f9a1145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-7154a423-e6b6-4445-bfa9-a3c2a22798d1" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-7154a423-e6b6-4445-bfa9-a3c2a22798d1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-d18b3058-a402-4087-818e-02873f9a1145" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-d18b3058-a402-4087-818e-02873f9a1145" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot d18b3058-a402-4087-818e-02873f9a1145 of volume 7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9b313-02ad-4245-b791-01ed54995026]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:09 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 Nov 02 10:56:09 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:10 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145" returned: 0 in 0.373s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[654ba4a0-268d-454c-83ec-debf6fee5f4f]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Creating offline snapshot a07cf8bc-08ca-45d3-a73f-b7aa19489ede of volume 5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:10 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 Nov 02 10:56:10 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f42dae-6b43-42d6-901d-a3176e3dccf1]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:10 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a Nov 02 10:56:10 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:10 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1" returned: 0 in 0.386s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:10 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 Nov 02 10:56:10 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:10 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a" returned: 0 in 0.385s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:10 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede 1G Nov 02 10:56:10 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:11 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145" returned: 0 in 0.386s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:11 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145 Nov 02 10:56:11 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:11 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede 1G" returned: 0 in 0.473s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5438d36c-e86f-4375-9cbc-30660104df8a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:11 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5438d36c-e86f-4375-9cbc-30660104df8a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede Nov 02 10:56:11 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:11 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1.d18b3058-a402-4087-818e-02873f9a1145" returned: 0 in 0.262s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-d18b3058-a402-4087-818e-02873f9a1145" released by "_delete_snapshot" :: held 1.523s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-7154a423-e6b6-4445-bfa9-a3c2a22798d1" released by "delete_snapshot" :: held 1.548s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Created reservations ['588b5ca0-2c9f-4de4-a732-b9423e818ffb', 'd264bb7f-7d03-46be-96c0-d4fd9d0b2ac9', 'b5703bc9-14ba-403d-9046-107385c68f98', 'ca210a22-043d-4e48-a2dc-c38a89c0241b'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-3e663021-24d1-4496-8950-b22fa58d747e tempest-ProjectMemberTests-612057540 None] Lock "cinder-d18b3058-a402-4087-818e-02873f9a1145-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:11 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5438d36c-e86f-4375-9cbc-30660104df8a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:11 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede is being set with open permissions: ugo+rw Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:11 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede Nov 02 10:56:11 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:11 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede" returned: 0 in 0.265s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:11 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info Nov 02 10:56:11 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-7154a423-e6b6-4445-bfa9-a3c2a22798d1-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Lock "cinder-7154a423-e6b6-4445-bfa9-a3c2a22798d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-7154a423-e6b6-4445-bfa9-a3c2a22798d1" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-7154a423-e6b6-4445-bfa9-a3c2a22798d1" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e9e8a-a5f6-4fe1-939a-963669bbcfca]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:12 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info" returned: 0 in 0.268s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:12 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info is being set with open permissions: ugo+rw Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:12 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info Nov 02 10:56:12 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:12 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 Nov 02 10:56:12 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:12 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.info" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b3f7e03b-cd6d-41e5-8ad0-364131900d41 tempest-ProjectReaderTests-679075022 None] Create snapshot completed successfully Nov 02 10:56:12 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1" returned: 0 in 0.421s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:12 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1 Nov 02 10:56:12 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:12 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7154a423-e6b6-4445-bfa9-a3c2a22798d1" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-7154a423-e6b6-4445-bfa9-a3c2a22798d1" released by "delete_volume" :: held 0.754s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Created reservations ['4758c841-9a0f-4b8a-a936-055cd1e1cc6a', '4562f39d-4e6b-47a2-ad88-93dd98bccf70', 'bd48320d-2a89-4281-991e-21643c986d06', 'bc62986d-b80f-40d1-9e5b-d07b0e3417d5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:12 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:12 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:13 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-03e308bc-a4d1-421a-a122-5e003a9ae81d tempest-ProjectMemberTests-612057540 None] Lock "cinder-7154a423-e6b6-4445-bfa9-a3c2a22798d1-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-a07cf8bc-08ca-45d3-a73f-b7aa19489ede-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (56e3c79c-7eb9-49f3-bf58-e4d282a5ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2ff8ea-bd73-436b-84c7-d4a75cd99100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Lock "cinder-a07cf8bc-08ca-45d3-a73f-b7aa19489ede-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-5438d36c-e86f-4375-9cbc-30660104df8a" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2ff8ea-bd73-436b-84c7-d4a75cd99100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952778290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58331d9-7eb4-40f9-9e74-8fc3fde9bd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:14Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed0c8de-84e5-48b6-82ba-3f3ca8cc5332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed0c8de-84e5-48b6-82ba-3f3ca8cc5332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef0ac74-d65c-447b-8c4c-24e1147d41de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef0ac74-d65c-447b-8c4c-24e1147d41de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58331d9-7eb4-40f9-9e74-8fc3fde9bd38', 'volume_name': 'volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9322f9-52b1-422b-8ed1-c7e0152cf687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9322f9-52b1-422b-8ed1-c7e0152cf687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dbf8e4-42f3-4f56-a773-207df587423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:13 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Volume e58331d9-7eb4-40f9-9e74-8fc3fde9bd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38', 'volume_size': 1} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952778290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58331d9-7eb4-40f9-9e74-8fc3fde9bd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:14Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Creating volume e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:13 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-5438d36c-e86f-4375-9cbc-30660104df8a" acquired by "delete_snapshot" :: waited 0.088s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:13 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 1073741824 Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-a07cf8bc-08ca-45d3-a73f-b7aa19489ede" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:13 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-a07cf8bc-08ca-45d3-a73f-b7aa19489ede" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Deleting offline snapshot a07cf8bc-08ca-45d3-a73f-b7aa19489ede of volume 5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] snapshot_file for this snap is: volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e17c5-a61f-4c00-a119-06491a80d2ab]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:13 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede Nov 02 10:56:13 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 1073741824" returned: 0 in 0.454s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede" returned: 0 in 0.399s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5438d36c-e86f-4375-9cbc-30660104df8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94d5085-9ec5-490d-9e67-ccc28fb1feca]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 Nov 02 10:56:14 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a Nov 02 10:56:14 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dbf8e4-42f3-4f56-a773-207df587423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ee0fc3-9ee4-4ff6-ae94-e8dd2d291b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:14 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Volume volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 (e58331d9-7eb4-40f9-9e74-8fc3fde9bd38): created successfully Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ee0fc3-9ee4-4ff6-ae94-e8dd2d291b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (56e3c79c-7eb9-49f3-bf58-e4d282a5ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-2235312a-d627-4b5a-a576-8f2c415c0920 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:56:14 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a" returned: 0 in 0.365s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede Nov 02 10:56:14 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede Nov 02 10:56:14 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a.a07cf8bc-08ca-45d3-a73f-b7aa19489ede" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-a07cf8bc-08ca-45d3-a73f-b7aa19489ede" released by "_delete_snapshot" :: held 1.450s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-5438d36c-e86f-4375-9cbc-30660104df8a" released by "delete_snapshot" :: held 1.473s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Created reservations ['fb51e090-5450-4af2-943c-a24d1c552415', '80d2c745-8709-42d6-a6e3-c12430a595f2', '64f63391-1a4f-4e2f-8a8b-0e10b0aca9db', '959ae4f0-3790-4f51-a22f-61f926624b7c'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:15 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Delete snapshot completed successfully. Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-e7471c9d-7f09-412e-ae37-2720cc07f6ff tempest-ProjectReaderTests-679075022 None] Lock "cinder-a07cf8bc-08ca-45d3-a73f-b7aa19489ede-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-5438d36c-e86f-4375-9cbc-30660104df8a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Lock "cinder-5438d36c-e86f-4375-9cbc-30660104df8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Acquiring lock "cinder-quobyte-5438d36c-e86f-4375-9cbc-30660104df8a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-5438d36c-e86f-4375-9cbc-30660104df8a" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Creating offline snapshot abcaf947-387c-4ea3-ac0d-7c83c64392f3 of volume e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1867ad1e-f363-43f6-b447-dcab3c023538]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[09962b27-923a-4bf1-90ff-e8c96c51891c]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:15 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a Nov 02 10:56:16 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 Nov 02 10:56:16 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a" returned: 0 in 0.377s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" returned: 0 in 0.376s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a Nov 02 10:56:16 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 1G Nov 02 10:56:16 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5438d36c-e86f-4375-9cbc-30660104df8a" returned: 0 in 0.260s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Lock "cinder-quobyte-5438d36c-e86f-4375-9cbc-30660104df8a" released by "delete_volume" :: held 0.709s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Created reservations ['ed82fac9-031f-4296-a29b-e67c7c32bc66', '46553773-1937-4f14-9afd-ba310b1accfe', '0e6aaf31-ad50-46d6-ba39-3d7d8bef546a', '0bb2c605-4bba-49ac-b1c6-54bb38895242'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:16 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 1G" returned: 0 in 0.411s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 Nov 02 10:56:16 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.263s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:16 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Deleted volume successfully. Nov 02 10:56:16 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-5936c5b6-4a6c-42df-881b-26f4acdc1d7a tempest-ProjectReaderTests-679075022 None] Lock "cinder-5438d36c-e86f-4375-9cbc-30660104df8a-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:17 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3" returned: 0 in 0.311s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 is being set with open permissions: ugo+rw Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 Nov 02 10:56:17 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3" returned: 0 in 0.240s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info Nov 02 10:56:17 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info" returned: 0 in 0.260s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info is being set with open permissions: ugo+rw Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info Nov 02 10:56:17 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.info" returned: 0 in 0.243s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:17 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-49078036-dc1d-4c43-a646-c82e7e7ed51d tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-abcaf947-387c-4ea3-ac0d-7c83c64392f3-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Lock "cinder-abcaf947-387c-4ea3-ac0d-7c83c64392f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-abcaf947-387c-4ea3-ac0d-7c83c64392f3" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-abcaf947-387c-4ea3-ac0d-7c83c64392f3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot abcaf947-387c-4ea3-ac0d-7c83c64392f3 of volume e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dcd80d-8bdc-4f42-8fdc-f87fbb25fe08]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 Nov 02 10:56:18 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3" returned: 0 in 0.395s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a1b0e-4ac0-4a14-866b-ed266c672cf9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 Nov 02 10:56:18 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" returned: 0 in 0.382s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 Nov 02 10:56:18 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:19 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3" returned: 0 in 0.362s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:19 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3 Nov 02 10:56:19 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:19 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38.abcaf947-387c-4ea3-ac0d-7c83c64392f3" returned: 0 in 0.259s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-abcaf947-387c-4ea3-ac0d-7c83c64392f3" released by "_delete_snapshot" :: held 1.517s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" released by "delete_snapshot" :: held 1.542s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Created reservations ['315c9d4b-608e-4185-98e0-10c986b1847b', '12bffccb-db58-41a3-8df7-4ecc1fc42305', '38862438-61a2-4aaf-8b6b-4acaa4da8d33', '16c26d3d-d33f-4bb5-b9f5-667d539a66ca'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:19 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:56:19 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ed795f9b-637f-452b-810d-4c693445d54b tempest-ProjectMemberTests-612057540 None] Lock "cinder-abcaf947-387c-4ea3-ac0d-7c83c64392f3-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Lock "cinder-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9413bd04-8b1a-4726-a481-b024010040cf]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 Nov 02 10:56:20 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:20 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" returned: 0 in 0.395s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38 Nov 02 10:56:20 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:20 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" returned: 0 in 0.238s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:20 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38" released by "delete_volume" :: held 0.698s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Created reservations ['5726c94b-4ec8-4668-a2e1-f5d0b982fa60', '00450f34-5082-4a5a-ae39-7920e12235fa', 'ebdd3d47-f564-4169-a07f-87fac536bf52', '9148c837-e68a-4bd4-96fc-7e8ddf4c3cf8'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:21 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:21 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:21 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.258s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:21 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-aa1665f5-96bf-4b9b-a1db-10e24fca01eb tempest-ProjectMemberTests-612057540 None] Lock "cinder-e58331d9-7eb4-40f9-9e74-8fc3fde9bd38-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (b62f13de-ec7a-488f-959a-c123b9056882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a147ac-8542-4216-bd14-16490384d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a147ac-8542-4216-bd14-16490384d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725075923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5462f11b-b7e6-473b-b1c2-5204a627c733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:22Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b79e4a3-3224-4832-8de9-dc92b905c8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b79e4a3-3224-4832-8de9-dc92b905c8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad368f4-be54-4665-808e-7510a5f3f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad368f4-be54-4665-808e-7510a5f3f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5462f11b-b7e6-473b-b1c2-5204a627c733', 'volume_name': 'volume-5462f11b-b7e6-473b-b1c2-5204a627c733', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bd153-413a-4811-8b44-f8c98a74b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bd153-413a-4811-8b44-f8c98a74b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8442278b-d9bb-4810-adbc-0e7a8f8e9787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:21 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Volume 5462f11b-b7e6-473b-b1c2-5204a627c733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5462f11b-b7e6-473b-b1c2-5204a627c733', 'volume_size': 1} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725075923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5462f11b-b7e6-473b-b1c2-5204a627c733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:22Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Creating volume 5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:21 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:21 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 1073741824 Nov 02 10:56:21 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:22 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 1073741824" returned: 0 in 0.464s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:22 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 Nov 02 10:56:22 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:22 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733" returned: 0 in 0.250s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8442278b-d9bb-4810-adbc-0e7a8f8e9787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5462f11b-b7e6-473b-b1c2-5204a627c733', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d8b658-d836-4941-a4d8-83abc02a8f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:22 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Volume volume-5462f11b-b7e6-473b-b1c2-5204a627c733 (5462f11b-b7e6-473b-b1c2-5204a627c733): created successfully Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d8b658-d836-4941-a4d8-83abc02a8f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (b62f13de-ec7a-488f-959a-c123b9056882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:22 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:22 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:22 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1d0cbaec-8eec-4f3b-9bf9-31664c8217a2 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:56:22 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.273s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:56:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Creating offline snapshot 58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 of volume 5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0599a-470d-479e-b6e3-7c7ac6b208bb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:24 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 Nov 02 10:56:24 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:24 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733" returned: 0 in 0.375s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:24 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 1G Nov 02 10:56:24 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:24 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 1G" returned: 0 in 0.400s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:24 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5462f11b-b7e6-473b-b1c2-5204a627c733 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:24 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5462f11b-b7e6-473b-b1c2-5204a627c733 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 Nov 02 10:56:24 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:25 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5462f11b-b7e6-473b-b1c2-5204a627c733 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" returned: 0 in 0.275s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:25 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 is being set with open permissions: ugo+rw Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:25 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 Nov 02 10:56:25 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:25 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" returned: 0 in 0.228s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:25 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info Nov 02 10:56:25 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:25 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:25 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info is being set with open permissions: ugo+rw Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:25 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info Nov 02 10:56:25 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:25 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.info" returned: 0 in 0.243s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:25 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:25 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-dc7ecd00-fa2f-4f21-8e1d-19833453ae54 tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Lock "cinder-58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-5462f11b-b7e6-473b-b1c2-5204a627c733" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5462f11b-b7e6-473b-b1c2-5204a627c733" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot 58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 of volume 5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee1830-e5d4-4fed-8af7-53eb6b594a96]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:26 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 Nov 02 10:56:26 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:26 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" returned: 0 in 0.402s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5462f11b-b7e6-473b-b1c2-5204a627c733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea0510-047c-42a4-afad-fe3a08694b8e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:26 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:26 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 Nov 02 10:56:26 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:27 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733" returned: 0 in 0.387s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:27 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 Nov 02 10:56:27 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:27 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" returned: 0 in 0.382s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:27 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02 Nov 02 10:56:27 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:27 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733.58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02" released by "_delete_snapshot" :: held 1.532s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5462f11b-b7e6-473b-b1c2-5204a627c733" released by "delete_snapshot" :: held 1.555s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Created reservations ['16a7e7d2-2db0-4d8d-8a79-1f8fb08430fe', 'ba5c1c50-c336-4a45-b0d0-6e74721292bb', '383f1a54-8504-4eff-abe7-a3fcd5a3ca50', 'bd77dede-36a9-47e0-8105-d86f20e1da58'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:27 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:56:27 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-ac6eed54-603f-4c28-8ae6-032100bf71d8 tempest-ProjectMemberTests-612057540 None] Lock "cinder-58dbf791-ed43-4cc1-a4e2-b3b1fcd2fa02-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-5462f11b-b7e6-473b-b1c2-5204a627c733-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Lock "cinder-5462f11b-b7e6-473b-b1c2-5204a627c733-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-5462f11b-b7e6-473b-b1c2-5204a627c733" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5462f11b-b7e6-473b-b1c2-5204a627c733" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e43a907-8005-452f-9fed-4e5fb4119dc7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:28 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 Nov 02 10:56:28 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:28 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733" returned: 0 in 0.358s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:28 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:28 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733 Nov 02 10:56:28 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:29 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-5462f11b-b7e6-473b-b1c2-5204a627c733" returned: 0 in 0.262s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5462f11b-b7e6-473b-b1c2-5204a627c733" released by "delete_volume" :: held 0.691s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Created reservations ['47ebb9f4-aa9f-4032-b7e6-05f3848b23ce', 'ac260b0e-fc60-4368-a732-c1c7edf516c3', '231445a2-4b0d-4dde-93fe-33453af2968e', '6d0b23fe-3e9d-49d6-8d91-243d8870e74a'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:29 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:29 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:29 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.279s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:29 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:56:29 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-1c1309d5-9d68-4754-8f9f-797ea4a7983b tempest-ProjectMemberTests-612057540 None] Lock "cinder-5462f11b-b7e6-473b-b1c2-5204a627c733-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (0f4ef36f-8b2c-44ac-ab58-acbfe50d31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342b4fde-5929-4d09-b40d-4d7452353876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342b4fde-5929-4d09-b40d-4d7452353876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794695378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e34c99c-18d8-4bf9-a6bc-44ba20e25812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:30Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0131fa21-ca2c-4253-a346-f0991f44e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0131fa21-ca2c-4253-a346-f0991f44e989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3202ac27-d166-485b-b5a1-c1f7b9d8d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3202ac27-d166-485b-b5a1-c1f7b9d8d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e34c99c-18d8-4bf9-a6bc-44ba20e25812', 'volume_name': 'volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13168a2-b1b2-43dc-85cc-0080e2993d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13168a2-b1b2-43dc-85cc-0080e2993d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f33657-bbd7-42da-9a39-07d80241fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:30 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Volume 2e34c99c-18d8-4bf9-a6bc-44ba20e25812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812', 'volume_size': 1} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794695378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e34c99c-18d8-4bf9-a6bc-44ba20e25812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:30Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Creating volume 2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:30 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 1073741824 Nov 02 10:56:30 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 1073741824" returned: 0 in 0.467s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 Nov 02 10:56:30 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" returned: 0 in 0.277s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f33657-bbd7-42da-9a39-07d80241fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9befe9fa-56aa-4ce6-80bd-a9c3b4fb5c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:30 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Volume volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 (2e34c99c-18d8-4bf9-a6bc-44ba20e25812): created successfully Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9befe9fa-56aa-4ce6-80bd-a9c3b4fb5c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:30 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (0f4ef36f-8b2c-44ac-ab58-acbfe50d31c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:30 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b2d7383a-3170-4416-b7f6-64115fa63797 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Creating offline snapshot de2fa2f0-b847-4f3d-9c65-789f110f5487 of volume 2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[9400a7d7-bf68-4f14-9c4e-0c4e51e8f3ee]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:32 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 Nov 02 10:56:32 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:32 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" returned: 0 in 0.350s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:32 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:32 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 1G Nov 02 10:56:32 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 1G" returned: 0 in 0.403s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 Nov 02 10:56:33 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487" returned: 0 in 0.292s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 is being set with open permissions: ugo+rw Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 Nov 02 10:56:33 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487" returned: 0 in 0.247s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info Nov 02 10:56:33 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info" returned: 0 in 0.265s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info is being set with open permissions: ugo+rw Nov 02 10:56:33 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info Nov 02 10:56:33 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:34 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.info" returned: 0 in 0.284s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:34 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-a7a81c5c-1ce3-495c-8cb4-632952dd53d8 tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-de2fa2f0-b847-4f3d-9c65-789f110f5487-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Lock "cinder-de2fa2f0-b847-4f3d-9c65-789f110f5487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-de2fa2f0-b847-4f3d-9c65-789f110f5487" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-de2fa2f0-b847-4f3d-9c65-789f110f5487" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot de2fa2f0-b847-4f3d-9c65-789f110f5487 of volume 2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3911bcf-8cd5-40cf-b833-d5104442cdd0]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:34 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 Nov 02 10:56:34 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:34 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487" returned: 0 in 0.363s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee11a8-3289-4c95-aaaf-693edb4de63b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:34 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:35 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 Nov 02 10:56:35 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:35 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:35 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 Nov 02 10:56:35 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:35 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487" returned: 0 in 0.353s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:35 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487 Nov 02 10:56:35 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:35 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812.de2fa2f0-b847-4f3d-9c65-789f110f5487" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-de2fa2f0-b847-4f3d-9c65-789f110f5487" released by "_delete_snapshot" :: held 1.452s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:35 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" released by "delete_snapshot" :: held 1.481s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Created reservations ['1b753ab9-9e22-4ccd-96a9-1856db401644', '97030699-c586-4850-a8d6-f9e739f66854', 'f35dd72d-4534-4b1a-bcde-d51cbce72892', '9499a5c3-0816-45d6-a69a-2f05123b4019'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:36 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-195d1fd0-10b8-419f-8bde-ff5e85ceb8cd tempest-ProjectMemberTests-612057540 None] Lock "cinder-de2fa2f0-b847-4f3d-9c65-789f110f5487-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-2e34c99c-18d8-4bf9-a6bc-44ba20e25812-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Lock "cinder-2e34c99c-18d8-4bf9-a6bc-44ba20e25812-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" acquired by "delete_volume" :: waited 0.019s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2bd2e-2b55-41ae-b3d8-24fe99be6a19]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:36 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:36 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 Nov 02 10:56:36 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:37 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812 Nov 02 10:56:37 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" returned: 0 in 0.251s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-2e34c99c-18d8-4bf9-a6bc-44ba20e25812" released by "delete_volume" :: held 0.699s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Created reservations ['291c037d-9a12-4b40-b9c0-fcb755564743', '35e14fe9-7503-4fa3-93ee-5e03cf2ad22c', '9ae51a81-1d27-4cfa-a61f-753a429b592b', '6c965d0b-666a-4366-bd6f-505c8b3910ab'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:37 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:37 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:37 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:56:37 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-80c57a2c-568e-4abe-93e2-6e8d724c60c9 tempest-ProjectMemberTests-612057540 None] Lock "cinder-2e34c99c-18d8-4bf9-a6bc-44ba20e25812-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (5feea4e5-ac1c-4c73-affe-bedef7eb2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88fafb8d-e13a-4550-8be1-4c4a58e4c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88fafb8d-e13a-4550-8be1-4c4a58e4c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048643866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2fd4ab-33c2-4e86-ae2e-40d809039fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:38Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9edcd0b-9bd0-452d-a98a-acc6c6949aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9edcd0b-9bd0-452d-a98a-acc6c6949aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923e927e-ef25-43ba-b361-40088c378e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923e927e-ef25-43ba-b361-40088c378e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f2fd4ab-33c2-4e86-ae2e-40d809039fdd', 'volume_name': 'volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ef1eb8-b0d0-49c6-ba82-366d87e98d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ef1eb8-b0d0-49c6-ba82-366d87e98d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be988455-ff3d-475c-b709-4f1822f5a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:38 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Volume 0f2fd4ab-33c2-4e86-ae2e-40d809039fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd', 'volume_size': 1} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048643866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2fd4ab-33c2-4e86-ae2e-40d809039fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be3a4c2b2d4f6c8edb378836e78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:38Z,use_quota=True,user_id='0abc4e83320b454fb564cf30218fe0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Creating volume 0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:38 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:38 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd 1073741824 Nov 02 10:56:38 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:38 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd 1073741824" returned: 0 in 0.460s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:38 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:38 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd Nov 02 10:56:38 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:39 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" returned: 0 in 0.250s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=177,cinder:INSERT=61,cinder:UPDATE=247,cinder:DELETE=21 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be988455-ff3d-475c-b709-4f1822f5a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d84d48-fc89-4d3c-a126-df91c116ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=259,cinder:SELECT=196,cinder:INSERT=73,cinder:DELETE=21 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:39 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Volume volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd (0f2fd4ab-33c2-4e86-ae2e-40d809039fdd): created successfully Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d84d48-fc89-4d3c-a126-df91c116ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Flow 'volume_create_manager' (5feea4e5-ac1c-4c73-affe-bedef7eb2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:39 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-47e54a5d-c1f5-4d6a-92ca-0dc6c64708f1 tempest-ProjectMemberTests-612057540 None] Created volume successfully. Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Creating offline snapshot 5984b87a-998f-4b09-a81b-df85df7f57b6 of volume 0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[1180d4df-6765-48d5-b5bb-2a6e45f6a8ac]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:39 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd Nov 02 10:56:39 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:39 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" returned: 0 in 0.376s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:39 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:39 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 1G Nov 02 10:56:39 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:40 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 1G" returned: 0 in 0.443s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:40 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 Nov 02 10:56:40 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:40 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6" returned: 0 in 0.325s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:40 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 is being set with open permissions: ugo+rw Nov 02 10:56:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:40 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 Nov 02 10:56:40 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:40 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:40 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:40 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info Nov 02 10:56:40 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:41 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info" returned: 0 in 0.269s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:41 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info is being set with open permissions: ugo+rw Nov 02 10:56:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:41 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info Nov 02 10:56:41 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:41 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.info" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:41 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:41 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-d7a6ed71-cb9a-4692-826f-04e33a8f3899 tempest-ProjectMemberTests-612057540 None] Create snapshot completed successfully Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-5984b87a-998f-4b09-a81b-df85df7f57b6-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Lock "cinder-5984b87a-998f-4b09-a81b-df85df7f57b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-5984b87a-998f-4b09-a81b-df85df7f57b6" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5984b87a-998f-4b09-a81b-df85df7f57b6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Deleting offline snapshot 5984b87a-998f-4b09-a81b-df85df7f57b6 of volume 0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] snapshot_file for this snap is: volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc406d-b8d9-4d3e-aec3-63325875a1c9]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:42 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:42 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 Nov 02 10:56:42 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:43 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6" returned: 0 in 0.443s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:43 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:43 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b588440-9a35-45cd-bce3-353aab6bd30b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:43 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd Nov 02 10:56:43 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:43 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" returned: 0 in 0.463s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:43 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:43 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 Nov 02 10:56:43 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:44 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6" returned: 0 in 0.384s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:44 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6 Nov 02 10:56:44 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:44 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd.5984b87a-998f-4b09-a81b-df85df7f57b6" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-5984b87a-998f-4b09-a81b-df85df7f57b6" released by "_delete_snapshot" :: held 1.660s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" released by "delete_snapshot" :: held 1.685s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Created reservations ['1b37a707-230d-4bac-9dd3-cba10db0fe50', 'd47b2c1b-86cb-4de0-be35-ddcf6e6affe3', '8cdbefdb-6931-4172-8cba-662d2422630c', '8515d369-fb3d-4735-8ff0-277e0ea6ec35'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:44 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Delete snapshot completed successfully. Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-90290eab-da73-453a-80f3-4be73c6a5111 tempest-ProjectMemberTests-612057540 None] Lock "cinder-5984b87a-998f-4b09-a81b-df85df7f57b6-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Lock "cinder-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:44 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Acquiring lock "cinder-quobyte-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" acquired by "delete_volume" :: waited 0.018s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eee6a60-54ee-4ef3-a87d-a8509c2885d7]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:45 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd Nov 02 10:56:45 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:45 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" returned: 0 in 0.373s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:45 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd Nov 02 10:56:45 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:45 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" returned: 0 in 0.264s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Lock "cinder-quobyte-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd" released by "delete_volume" :: held 0.706s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Created reservations ['6d3a58c2-8e0f-4cbf-858a-df2ebcef24da', '58ad9a56-da5c-419b-86a3-2e381a0edf65', '2731912a-8daf-4c38-b534-4b1a454f59a0', 'bcca79b2-72a4-4d25-a96b-df1d26960e48'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:45 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:45 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:56:45 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:46 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:46 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.254s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:46 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:46 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Deleted volume successfully. Nov 02 10:56:46 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-72516df9-36f3-4027-8030-13f3a08635c6 tempest-ProjectMemberTests-612057540 None] Lock "cinder-0f2fd4ab-33c2-4e86-ae2e-40d809039fdd-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:55 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:56 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=16,cinder:DELETE=2,cinder:SELECT=13,cinder:INSERT=5 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Flow 'volume_create_manager' (fec2040f-65c6-4521-b9ab-57c763fd1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b41f543-baff-4d8b-a56c-e750e65184f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b41f543-baff-4d8b-a56c-e750e65184f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-801997692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7887505a-333f-42c2-957a-2d0139d9490a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514dc6a512f14a789e5a311a6bf3b8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:57Z,use_quota=True,user_id='bae233ebbd8d4cd4bef19e9e62a21cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ad06c8-f017-42cf-96ad-9a8d0a6590d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ad06c8-f017-42cf-96ad-9a8d0a6590d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5111176-a8cf-4be7-8de2-65fc12fd7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5111176-a8cf-4be7-8de2-65fc12fd7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7887505a-333f-42c2-957a-2d0139d9490a', 'volume_name': 'volume-7887505a-333f-42c2-957a-2d0139d9490a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14551a08-0150-4c2e-af0d-89a9b8aff026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14551a08-0150-4c2e-af0d-89a9b8aff026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578d5ed1-c5d6-46bd-a5ac-ae91ebbf6f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:57 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Volume 7887505a-333f-42c2-957a-2d0139d9490a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7887505a-333f-42c2-957a-2d0139d9490a', 'volume_size': 1} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-801997692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7887505a-333f-42c2-957a-2d0139d9490a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514dc6a512f14a789e5a311a6bf3b8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:57Z,use_quota=True,user_id='bae233ebbd8d4cd4bef19e9e62a21cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)}" {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Creating volume 7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:57 devstack cinder-volume[86926]: INFO cinder.volume.drivers.remotefs [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] casted to osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 Nov 02 10:56:57 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a 1073741824 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:57 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a 1073741824 Nov 02 10:56:57 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:58 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a 1073741824" returned: 0 in 0.577s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:58 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a Nov 02 10:56:58 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:58 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a" returned: 0 in 0.271s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'} {{(pid=86926) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578d5ed1-c5d6-46bd-a5ac-ae91ebbf6f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7887505a-333f-42c2-957a-2d0139d9490a', 'volume_size': 1}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6355dad8-99b0-48fd-a025-8dffd4746df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:58 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Volume volume-7887505a-333f-42c2-957a-2d0139d9490a (7887505a-333f-42c2-957a-2d0139d9490a): created successfully Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6355dad8-99b0-48fd-a025-8dffd4746df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:58 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Flow 'volume_create_manager' (fec2040f-65c6-4521-b9ab-57c763fd1316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:58 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-901f1c1f-34aa-43c1-9714-8f5ff138e27a tempest-SnapshotDependencyTests-1630283943 None] Created volume successfully. Nov 02 10:56:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:59 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Creating offline snapshot 0b070c4e-4ddd-420b-9e0b-5e106df48703 of volume 7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:59 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff0458-4a4d-4521-b202-9d9a883506db]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:59 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:59 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a Nov 02 10:56:59 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:00 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a" returned: 0 in 0.370s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 1G {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:00 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 1G Nov 02 10:57:00 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:00 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 1G" returned: 0 in 0.387s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7887505a-333f-42c2-957a-2d0139d9490a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:00 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7887505a-333f-42c2-957a-2d0139d9490a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 Nov 02 10:57:00 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:00 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7887505a-333f-42c2-957a-2d0139d9490a -F qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703" returned: 0 in 0.274s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:00 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 is being set with open permissions: ugo+rw Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:00 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 Nov 02 10:57:00 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:00 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:00 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703" returned: 0 in 0.252s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:01 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info Nov 02 10:57:01 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:01 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info" returned: 0 in 0.253s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:01 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info is being set with open permissions: ugo+rw Nov 02 10:57:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:01 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info Nov 02 10:57:01 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:01 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.info" returned: 0 in 0.238s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:01 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:01 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-5cafc2ab-53ef-4fcf-b2e7-388f50c92ec4 tempest-SnapshotDependencyTests-1630283943 None] Create snapshot completed successfully Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Flow 'volume_create_manager' (78aee316-8d6f-4a51-b4e3-0ef208d21e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ded62cb-3dc8-4b09-ba57-55e2594ca97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ded62cb-3dc8-4b09-ba57-55e2594ca97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd63128f-3136-4a47-93a4-d2a39c516d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514dc6a512f14a789e5a311a6bf3b8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b070c4e-4ddd-420b-9e0b-5e106df48703,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:02Z,use_quota=True,user_id='bae233ebbd8d4cd4bef19e9e62a21cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb370406-8a34-4bb0-b5ac-b62d4df3d588),volume_type_id=bb370406-8a34-4bb0-b5ac-b62d4df3d588)' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c06e5b6-9b8e-4a28-8863-100b79f99bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c06e5b6-9b8e-4a28-8863-100b79f99bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e120f11c-f69e-41cb-8bed-8e5c42e920b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e120f11c-f69e-41cb-8bed-8e5c42e920b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd63128f-3136-4a47-93a4-d2a39c516d52', 'volume_name': 'volume-cd63128f-3136-4a47-93a4-d2a39c516d52', 'volume_size': 1, 'snapshot_id': '0b070c4e-4ddd-420b-9e0b-5e106df48703'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c078cd-f06a-47a8-9cde-a94bf1717d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c078cd-f06a-47a8-9cde-a94bf1717d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2a3323-2d16-4632-ae89-89e9fc7cab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:02 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Volume cd63128f-3136-4a47-93a4-d2a39c516d52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd63128f-3136-4a47-93a4-d2a39c516d52', 'volume_size': 1, 'snapshot_id': '0b070c4e-4ddd-420b-9e0b-5e106df48703'} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-quobyte-0b070c4e-4ddd-420b-9e0b-5e106df48703-cd63128f-3136-4a47-93a4-d2a39c516d52" by "_create_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-0b070c4e-4ddd-420b-9e0b-5e106df48703-cd63128f-3136-4a47-93a4-d2a39c516d52" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Creating volume cd63128f-3136-4a47-93a4-d2a39c516d52 from snapshot 0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Selected osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01 as target Quobyte volume. {{(pid=86926) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-quobyte-cd63128f-3136-4a47-93a4-d2a39c516d52" by "_copy_volume_from_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-cd63128f-3136-4a47-93a4-d2a39c516d52" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] snapshot: 0b070c4e-4ddd-420b-9e0b-5e106df48703, volume: cd63128f-3136-4a47-93a4-d2a39c516d52, {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2ce49-134e-44d6-b146-c059ec03a730]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:02 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 Nov 02 10:57:02 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:02 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703" returned: 0 in 0.355s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7887505a-333f-42c2-957a-2d0139d9490a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8fd0e-8f42-458f-99e5-3e1f12c77619]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:02 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:03 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a Nov 02 10:57:03 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:03 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a" returned: 0 in 0.375s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:57:03 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Creating direct copy from snapshot {{(pid=86926) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:57:03 devstack cinder-volume[86926]: DEBUG cinder.utils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Path /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 not found in is_blk_device check {{(pid=86926) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:57:03 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:03 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 Nov 02 10:57:03 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:09 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52" returned: 0 in 5.801s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Image conversion details: src /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 {{(pid=86926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:57:09 devstack cinder-volume[86926]: INFO cinder.image.image_utils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Converted 1024.00 MB image at 176.49 MB/s Nov 02 10:57:09 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.remotefs [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 is being set with open permissions: ugo+rw Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:09 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 Nov 02 10:57:09 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:09 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52" returned: 0 in 0.232s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-cd63128f-3136-4a47-93a4-d2a39c516d52" released by "_copy_volume_from_snapshot" :: held 6.846s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-0b070c4e-4ddd-420b-9e0b-5e106df48703-cd63128f-3136-4a47-93a4-d2a39c516d52" released by "_create_volume_from_snapshot" :: held 6.910s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.925s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2a3323-2d16-4632-ae89-89e9fc7cab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd63128f-3136-4a47-93a4-d2a39c516d52', 'volume_size': 1, 'snapshot_id': '0b070c4e-4ddd-420b-9e0b-5e106df48703'}' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8220dc-cd22-4507-97aa-d1b1569de166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:09 devstack cinder-volume[86926]: INFO cinder.volume.flows.manager.create_volume [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Volume volume-cd63128f-3136-4a47-93a4-d2a39c516d52 (cd63128f-3136-4a47-93a4-d2a39c516d52): created successfully Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8220dc-cd22-4507-97aa-d1b1569de166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86926) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Flow 'volume_create_manager' (78aee316-8d6f-4a51-b4e3-0ef208d21e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86926) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:09 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-b58eb179-9a52-4ffe-89dc-b74a819f4423 tempest-SnapshotDependencyTests-1630283943 None] Created volume successfully. Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-0b070c4e-4ddd-420b-9e0b-5e106df48703-delete_snapshot" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-0b070c4e-4ddd-420b-9e0b-5e106df48703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-quobyte-7887505a-333f-42c2-957a-2d0139d9490a" by "delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-7887505a-333f-42c2-957a-2d0139d9490a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-quobyte-0b070c4e-4ddd-420b-9e0b-5e106df48703" by "_delete_snapshot" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-0b070c4e-4ddd-420b-9e0b-5e106df48703" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:09 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Deleting offline snapshot 0b070c4e-4ddd-420b-9e0b-5e106df48703 of volume 7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] snapshot_file for this snap is: volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b3e8f5-4183-4a3e-8e9a-ecd28fda16b3]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:10 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 Nov 02 10:57:10 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:10 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703" returned: 0 in 0.352s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7887505a-333f-42c2-957a-2d0139d9490a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86926) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4922d2e-a485-4c9f-b7d7-50d9625c775b]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:10 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a Nov 02 10:57:10 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:10 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a" returned: 0 in 0.521s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:10 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:10 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 Nov 02 10:57:10 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:11 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703" returned: 0 in 0.317s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:11 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703 Nov 02 10:57:11 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:11 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a.0b070c4e-4ddd-420b-9e0b-5e106df48703" returned: 0 in 0.233s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-0b070c4e-4ddd-420b-9e0b-5e106df48703" released by "_delete_snapshot" :: held 1.524s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-7887505a-333f-42c2-957a-2d0139d9490a" released by "delete_snapshot" :: held 1.543s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Created reservations ['8c8e1f34-fb25-4974-86fd-f204614bf9f1', '0e5e9074-78d9-4e61-b358-ae0758afd95b', 'b841c4e7-d87f-422d-977b-79eaad289f94', 'b0eecf84-e774-4540-876b-9ae89e5feec2'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Delete snapshot completed successfully. Nov 02 10:57:11 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-08614455-d445-46d9-a7ec-7a61635de186 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-0b070c4e-4ddd-420b-9e0b-5e106df48703-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-7887505a-333f-42c2-957a-2d0139d9490a-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-7887505a-333f-42c2-957a-2d0139d9490a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-quobyte-7887505a-333f-42c2-957a-2d0139d9490a" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-7887505a-333f-42c2-957a-2d0139d9490a" acquired by "delete_volume" :: waited 0.013s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe23462-68bf-46ba-a4ca-b22811427beb]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:12 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a Nov 02 10:57:12 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:12 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a" returned: 0 in 0.341s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:12 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a Nov 02 10:57:12 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:12 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-7887505a-333f-42c2-957a-2d0139d9490a" returned: 0 in 0.244s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-7887505a-333f-42c2-957a-2d0139d9490a" released by "delete_volume" :: held 0.643s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Created reservations ['115d342c-43ec-4be5-9b77-a7a9e198de73', '96cb1604-b8e5-4394-8640-77fc058959e6', 'fda91011-bb60-4972-8b9f-26d8c936021e', '25ca5d3c-02ce-47f0-b09f-7806e527a4f5'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:12 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:57:12 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:13 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.247s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Deleted volume successfully. Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-60de31e7-602e-4d0d-9598-bf1f9e4a291d tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-7887505a-333f-42c2-957a-2d0139d9490a-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-cd63128f-3136-4a47-93a4-d2a39c516d52-delete_volume" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-cd63128f-3136-4a47-93a4-d2a39c516d52-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "cinder-quobyte-cd63128f-3136-4a47-93a4-d2a39c516d52" by "delete_volume" {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-cd63128f-3136-4a47-93a4-d2a39c516d52" acquired by "delete_volume" :: waited 0.021s {{(pid=86926) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7409f58-35ef-4c58-8109-96ec553d106e]: (4, 'qcow2') {{(pid=88156) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:13 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 Nov 02 10:57:13 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:13 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52" returned: 0 in 0.352s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:13 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52 Nov 02 10:57:13 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:13 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b/volume-cd63128f-3136-4a47-93a4-d2a39c516d52" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-quobyte-cd63128f-3136-4a47-93a4-d2a39c516d52" released by "delete_volume" :: held 0.636s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:13 devstack cinder-volume[86926]: DEBUG cinder.quota [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Created reservations ['78adbfd9-1916-4a99-980a-e7c12b1d6635', 'f10eda5e-8f7b-4737-83a2-af1c3adbc77c', '494c1c27-74c2-4b18-8e47-aa8be45aa262', 'a080dad1-09f2-4e15-8766-6b113e3e4a09'] {{(pid=86926) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:14 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:57:14 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:14 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.242s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:14 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Deleted volume successfully. Nov 02 10:57:14 devstack cinder-volume[86926]: DEBUG cinder.coordination [None req-70f83f4e-d1a9-4888-ad07-0931c2b1f084 tempest-SnapshotDependencyTests-1630283943 None] Lock "cinder-cd63128f-3136-4a47-93a4-d2a39c516d52-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86926) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04e22e88-405c-4dc7-9d60-3be155633f01'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:22 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b Nov 02 10:57:22 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:22 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9185ea2f26bef41a1ebdfc060e1cb52b" returned: 0 in 0.253s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG oslo_service.periodic_task [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] Running periodic task VolumeManager._thread_info {{(pid=86926) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread count: 28 {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:57:22 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-35474aeb-9411-435b-83db-5c65808c0f6a None None] thread info: [<_MainThread(MainThread, started 139238186721408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86926) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:57:24 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:24 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}